May 01 22:23:33 user devstack@n-api.service[61363]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 01 22:23:33 user devstack@n-api.service[61363]: *** Starting uWSGI 2.0.20-debian (64bit) on [Mon May 1 22:23:33 2023] *** May 01 22:23:33 user devstack@n-api.service[61363]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 01 22:23:33 user devstack@n-api.service[61363]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 May 01 22:23:33 user devstack@n-api.service[61363]: nodename: user May 01 22:23:33 user devstack@n-api.service[61363]: machine: x86_64 May 01 22:23:33 user devstack@n-api.service[61363]: clock source: unix May 01 22:23:33 user devstack@n-api.service[61363]: pcre jit disabled May 01 22:23:33 user devstack@n-api.service[61363]: detected number of CPU cores: 12 May 01 22:23:33 user devstack@n-api.service[61363]: current working directory: / May 01 22:23:33 user devstack@n-api.service[61363]: detected binary path: /usr/bin/uwsgi-core May 01 22:23:33 user devstack@n-api.service[61363]: your processes number limit is 63638 May 01 22:23:33 user devstack@n-api.service[61363]: your memory page size is 4096 bytes May 01 22:23:33 user devstack@n-api.service[61363]: detected max file descriptor number: 2048 May 01 22:23:33 user devstack@n-api.service[61363]: lock engine: pthread robust mutexes May 01 22:23:33 user devstack@n-api.service[61363]: thunder lock: enabled May 01 22:23:33 user devstack@n-api.service[61363]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 01 22:23:33 user devstack@n-api.service[61363]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] May 01 22:23:33 user devstack@n-api.service[61363]: Python main interpreter initialized at 0x560031642990 May 01 22:23:33 user devstack@n-api.service[61363]: python threads support enabled May 01 22:23:33 user devstack@n-api.service[61363]: your server socket listen backlog is limited to 100 connections May 01 22:23:33 user devstack@n-api.service[61363]: your mercy for graceful operations on workers is 90 seconds May 01 22:23:33 user devstack@n-api.service[61363]: mapped 537436 bytes (524 KB) for 3 cores May 01 22:23:33 user devstack@n-api.service[61363]: *** Operational MODE: preforking *** May 01 22:23:33 user devstack@n-api.service[61363]: *** uWSGI is running in multiple interpreter mode *** May 01 22:23:33 user devstack@n-api.service[61363]: spawned uWSGI master process (pid: 61363) May 01 22:23:33 user devstack@n-api.service[61363]: spawned uWSGI worker 1 (pid: 61364, cores: 1) May 01 22:23:33 user devstack@n-api.service[61363]: spawned uWSGI worker 2 (pid: 61365, cores: 1) May 01 22:23:33 user devstack@n-api.service[61363]: spawned uWSGI worker 3 (pid: 61366, cores: 1) May 01 22:23:33 user devstack@n-api.service[61363]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 01 22:23:34 user devstack@n-api.service[61365]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 01 22:23:34 user devstack@n-api.service[61366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 01 22:23:34 user devstack@n-api.service[61364]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 01 22:23:37 user devstack@n-api.service[61366]: live_migration_uri is deprecated for removal in favor of two other options that May 01 22:23:37 user devstack@n-api.service[61366]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 01 22:23:37 user devstack@n-api.service[61366]: and ``live_migration_inbound_addr`` respectively. May 01 22:23:37 user devstack@n-api.service[61366]: ). Its value may be silently ignored in the future. May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 01 22:23:37 user devstack@n-api.service[61365]: live_migration_uri is deprecated for removal in favor of two other options that May 01 22:23:37 user devstack@n-api.service[61365]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 01 22:23:37 user devstack@n-api.service[61365]: and ``live_migration_inbound_addr`` respectively. May 01 22:23:37 user devstack@n-api.service[61365]: ). Its value may be silently ignored in the future. May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 01 22:23:37 user devstack@n-api.service[61364]: live_migration_uri is deprecated for removal in favor of two other options that May 01 22:23:37 user devstack@n-api.service[61364]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 01 22:23:37 user devstack@n-api.service[61364]: and ``live_migration_inbound_addr`` respectively. May 01 22:23:37 user devstack@n-api.service[61364]: ). Its value may be silently ignored in the future. May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} May 01 22:23:38 user devstack@n-api.service[61366]: INFO dbcounter [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Registered counter for database nova_api May 01 22:23:38 user devstack@n-api.service[61365]: INFO dbcounter [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Registered counter for database nova_api May 01 22:23:38 user devstack@n-api.service[61364]: INFO dbcounter [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Registered counter for database nova_api May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_db.sqlalchemy.engines [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61364) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writer thread running {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG nova.context [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3894b638-48b8-4a73-93b9-2ff19b42c5cd(cell1) {{(pid=61366) load_cells /opt/stack/nova/nova/context.py:464}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.context [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3894b638-48b8-4a73-93b9-2ff19b42c5cd(cell1) {{(pid=61365) load_cells /opt/stack/nova/nova/context.py:464}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61366]: INFO dbcounter [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61365]: INFO dbcounter [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61366]: INFO dbcounter [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Registered counter for database nova_cell1 May 01 22:23:38 user devstack@n-api.service[61365]: INFO dbcounter [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Registered counter for database nova_cell1 May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG nova.context [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3894b638-48b8-4a73-93b9-2ff19b42c5cd(cell1) {{(pid=61364) load_cells /opt/stack/nova/nova/context.py:464}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:23:38 user devstack@n-api.service[61364]: INFO dbcounter [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61364]: INFO dbcounter [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Registered counter for database nova_cell1 May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_db.sqlalchemy.engines [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61364) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writer thread running {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_db.sqlalchemy.engines [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61364) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61366]: INFO dbcounter [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61365]: INFO dbcounter [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writer thread running {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: INFO dbcounter [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Registered counter for database nova_cell0 May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG oslo_db.sqlalchemy.engines [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61364) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} May 01 22:23:38 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writer thread running {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} May 01 22:23:38 user devstack@n-api.service[61364]: WARNING keystonemiddleware.auth_token [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61364]: WARNING keystonemiddleware.auth_token [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61365]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560031642990 pid: 61365 (default app) May 01 22:23:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:23:38 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001420 May 01 22:23:38 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Mon May 1 22:23:38 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:23:38 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-d4a3366d-f429-4bcc-a397-a31e0555d78a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61366]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560031642990 pid: 61366 (default app) May 01 22:23:38 user devstack@n-api.service[61364]: WARNING keystonemiddleware.auth_token [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 01 22:23:38 user devstack@n-api.service[61364]: WARNING keystonemiddleware.auth_token [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 01 22:23:38 user devstack@n-api.service[61364]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560031642990 pid: 61364 (default app) May 01 22:25:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0e90e246-37d6-4109-9fc3-0304145f89a4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001594 May 01 22:25:47 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a3655921-4ad9-49ef-90dc-fcbd1ca43873 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a3655921-4ad9-49ef-90dc-fcbd1ca43873 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.381206 May 01 22:25:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Mon May 1 22:25:47 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:25:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001892 May 01 22:25:50 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:25:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-50adcb9a-35fd-4c52-a714-37593e1c3615 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-50adcb9a-35fd-4c52-a714-37593e1c3615 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415915 May 01 22:25:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:25:50 2023] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:25:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ad756ea4-1bb0-4799-a505-8d3a76c9b8b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ad756ea4-1bb0-4799-a505-8d3a76c9b8b9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045836 May 01 22:25:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Mon May 1 22:25:50 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:25:52 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:52 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001267 May 01 22:25:52 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-563d747c-a596-4703-9407-ae9da22ec3bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-563d747c-a596-4703-9407-ae9da22ec3bc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068954 May 01 22:25:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:25:52 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:25:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-83164708-bbbe-4a2e-95a3-5a128b255324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-83164708-bbbe-4a2e-95a3-5a128b255324 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034399 May 01 22:25:52 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Mon May 1 22:25:52 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:25:54 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:54 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002246 May 01 22:25:54 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:54 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-70efea9a-99b1-4327-8844-e375c2c7f06a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-70efea9a-99b1-4327-8844-e375c2c7f06a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076485 May 01 22:25:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:25:54 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:25:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e6f1c3d1-61d4-4584-ab4b-2eae82e0a782 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e6f1c3d1-61d4-4584-ab4b-2eae82e0a782 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027566 May 01 22:25:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Mon May 1 22:25:54 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:25:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001510 May 01 22:25:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b48b6439-1d83-43a1-a36e-47c680996acf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b48b6439-1d83-43a1-a36e-47c680996acf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061939 May 01 22:25:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:25:56 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:25:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a3da32c5-80dc-4cc3-b257-1bd076e14251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a3da32c5-80dc-4cc3-b257-1bd076e14251 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027953 May 01 22:25:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Mon May 1 22:25:56 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:25:58 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:25:58 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001316 May 01 22:25:58 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:25:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:25:58 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e4facaee-ab0c-4cd7-a07b-333f4c7a6175 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "ram": 4096, "id": "d4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:58 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e4facaee-ab0c-4cd7-a07b-333f4c7a6175 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061354 May 01 22:25:58 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:25:58 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:25:58 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:25:58 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024602 May 01 22:25:58 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Mon May 1 22:25:58 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:00 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:00 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-833b7648-a6b2-47b0-82b7-2d4d31224e27 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001288 May 01 22:26:00 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:00 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-5edd2f7f-7082-44fb-989c-b35fccb9eb70 admin admin] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-5edd2f7f-7082-44fb-989c-b35fccb9eb70 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.073483 May 01 22:26:00 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Mon May 1 22:26:00 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:26:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003233 May 01 22:26:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:02 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:26:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:26:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:26:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:26:02 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-66aab24b-2700-44a4-8e00-acc06e4efff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:02 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-66aab24b-2700-44a4-8e00-acc06e4efff1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.325338 May 01 22:26:02 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:26:02 2023] POST /compute/v2.1/flavors => generated 400 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:26:02 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-14bba8ed-9ea6-4cb0-9456-d5c99a3286a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:02 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-14bba8ed-9ea6-4cb0-9456-d5c99a3286a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042534 May 01 22:26:02 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Mon May 1 22:26:02 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002075 May 01 22:26:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-7e9c0b7e-a7d3-470f-8707-c58eb505e5d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:04 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-7e9c0b7e-a7d3-470f-8707-c58eb505e5d0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056889 May 01 22:26:04 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:26:04 2023] POST /compute/v2.1/flavors => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:26:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-50123632-c5df-4bb1-b867-1a19cd1301ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-50123632-c5df-4bb1-b867-1a19cd1301ca admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034224 May 01 22:26:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Mon May 1 22:26:04 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:06 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:06 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001308 May 01 22:26:06 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:06 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-21ecfe28-6754-436c-9ba1-3b5daff88017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "swap": 0, "ram": 4096, "name": "m1.medium", "vcpus": 2}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:06 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-21ecfe28-6754-436c-9ba1-3b5daff88017 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059268 May 01 22:26:06 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:26:06 2023] POST /compute/v2.1/flavors => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:26:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-920d9de7-8ba9-418f-b91b-0dd80d34c957 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-920d9de7-8ba9-418f-b91b-0dd80d34c957 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025315 May 01 22:26:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Mon May 1 22:26:06 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001454 May 01 22:26:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:08 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:08 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-d8319bed-bc27-48bf-a79d-c89e94ae5af7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:08 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-d8319bed-bc27-48bf-a79d-c89e94ae5af7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058462 May 01 22:26:08 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:26:08 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:26:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-45875e1b-aacc-4d4a-8f66-d0eeedc9ed12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-45875e1b-aacc-4d4a-8f66-d0eeedc9ed12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023961 May 01 22:26:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Mon May 1 22:26:08 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:10 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:10 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001356 May 01 22:26:10 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Mon May 1 22:26:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:10 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-d451761a-8101-468f-ba2f-6712a2620726 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "vcpus": 8, "disk": 160}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:10 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-d451761a-8101-468f-ba2f-6712a2620726 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.108563 May 01 22:26:10 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Mon May 1 22:26:10 2023] POST /compute/v2.1/flavors => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:26:10 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1f05e92b-d567-44ca-aef1-e24bd150e2bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:26:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1f05e92b-d567-44ca-aef1-e24bd150e2bd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024889 May 01 22:26:10 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Mon May 1 22:26:10 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:26:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-95ba5a89-0046-4a97-9ccd-c5959a3c5ef9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001989 May 01 22:26:41 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Mon May 1 22:26:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:26:41 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:26:41 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.091245 May 01 22:26:41 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Mon May 1 22:26:41 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:27:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1f05e92b-d567-44ca-aef1-e24bd150e2bd admin admin] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:27:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1f05e92b-d567-44ca-aef1-e24bd150e2bd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002637 May 01 22:27:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Mon May 1 22:27:13 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:27:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:27:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-553fa426-ce71-4219-b30e-694795bc55b0 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:27:13 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-553fa426-ce71-4219-b30e-694795bc55b0 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.066821 May 01 22:27:13 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Mon May 1 22:27:13 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:27:17 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:27:17 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002408 May 01 22:27:17 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Mon May 1 22:27:17 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:27:17 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:27:17 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-4b0e59ef-7596-496f-bb70-5c50c24189c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "42", "name": "m1.nano", "rxtx_factor": 1.0, "swap": 0, "ram": 128, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:27:17 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-4b0e59ef-7596-496f-bb70-5c50c24189c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.080867 May 01 22:27:17 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Mon May 1 22:27:17 2023] POST /compute/v2.1/flavors => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:27:17 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-75868ec8-6e1a-4699-ad87-255338dc765d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:27:17 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-75868ec8-6e1a-4699-ad87-255338dc765d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026994 May 01 22:27:17 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Mon May 1 22:27:17 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:27:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:27:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8d26f268-5f43-4780-8531-34885a1bd39d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001350 May 01 22:27:21 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Mon May 1 22:27:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:27:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3bac9492-4611-4f0f-884e-2f3d71b10243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "84", "swap": 0, "name": "m1.micro", "ram": 192, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:27:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3bac9492-4611-4f0f-884e-2f3d71b10243 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068269 May 01 22:27:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Mon May 1 22:27:21 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:27:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-30ba00d1-633e-4f3c-ab9a-91cd2b7838cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:27:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-30ba00d1-633e-4f3c-ab9a-91cd2b7838cc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030781 May 01 22:27:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Mon May 1 22:27:21 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4e588181-1b9b-4c1a-98bd-244fb8fca9d0 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Action: 'create', calling method: .version_select at 0x7fc7055ab9a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1843769305", "metadata": {"Type": "work"}}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4e588181-1b9b-4c1a-98bd-244fb8fca9d0 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:56 user devstack@n-api.service[61364]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 01 22:29:56 user devstack@n-api.service[61364]: Accept: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:29:56 user devstack@n-api.service[61364]: Connection: close May 01 22:29:56 user devstack@n-api.service[61364]: Content-Length: 122 May 01 22:29:56 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:29:56 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:29:56 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:29:56 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:29:56 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: May 01 22:29:56 user devstack@n-api.service[61364]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1843769305", "metadata": {"Type": "work"}}} May 01 22:29:56 user devstack@n-api.service[61364]: method: May 01 22:29:56 user devstack@n-api.service[61364]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61364]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1843769305', 'metadata': {'Type': 'work'}}}} May 01 22:29:56 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise error May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi On instance['volume']: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi '#$%' May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4e588181-1b9b-4c1a-98bd-244fb8fca9d0 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-4e588181-1b9b-4c1a-98bd-244fb8fca9d0 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146343 May 01 22:29:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Mon May 1 22:29:56 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:29:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d4717f6c-4a33-49f8-a815-7650df5d5adc tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Action: 'create', calling method: .version_select at 0x7fc7054c29e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1595303343", "metadata": {"Type": "work"}}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:29:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d4717f6c-4a33-49f8-a815-7650df5d5adc tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:56 user devstack@n-api.service[61365]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 01 22:29:56 user devstack@n-api.service[61365]: Accept: application/json May 01 22:29:56 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:29:56 user devstack@n-api.service[61365]: Connection: close May 01 22:29:56 user devstack@n-api.service[61365]: Content-Length: 120 May 01 22:29:56 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:29:56 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:29:56 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:29:56 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:29:56 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:56 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:29:56 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:29:56 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:29:56 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:29:56 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61365]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:29:56 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:29:56 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:56 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61365]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61365]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61365]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:56 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61365]: May 01 22:29:56 user devstack@n-api.service[61365]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1595303343", "metadata": {"Type": "work"}}} May 01 22:29:56 user devstack@n-api.service[61365]: method: May 01 22:29:56 user devstack@n-api.service[61365]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 01 22:29:56 user devstack@n-api.service[61365]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1595303343', 'metadata': {'Type': 'work'}}}} May 01 22:29:56 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise error May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi On instance['volume']: May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi '0' May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 01 22:29:56 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d4717f6c-4a33-49f8-a815-7650df5d5adc tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d4717f6c-4a33-49f8-a815-7650df5d5adc tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022339 May 01 22:29:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Mon May 1 22:29:56 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:29:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-359682a1-ee36-4985-b376-1cc2b808bbd6 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Action: 'create', calling method: .version_select at 0x7fc7056976d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-985259063", "metadata": {"Type": "work"}}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:29:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-359682a1-ee36-4985-b376-1cc2b808bbd6 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:56 user devstack@n-api.service[61366]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 01 22:29:56 user devstack@n-api.service[61366]: Accept: application/json May 01 22:29:56 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:29:56 user devstack@n-api.service[61366]: Connection: close May 01 22:29:56 user devstack@n-api.service[61366]: Content-Length: 118 May 01 22:29:56 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:29:56 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:29:56 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:29:56 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:29:56 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:56 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:29:56 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:29:56 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:29:56 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:29:56 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61366]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:29:56 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:29:56 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:56 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61366]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61366]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61366]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:56 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61366]: May 01 22:29:56 user devstack@n-api.service[61366]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-985259063", "metadata": {"Type": "work"}}} May 01 22:29:56 user devstack@n-api.service[61366]: method: May 01 22:29:56 user devstack@n-api.service[61366]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61366]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-985259063', 'metadata': {'Type': 'work'}}}} May 01 22:29:56 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise error May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi On instance['volume']: May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi '' May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 01 22:29:56 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-359682a1-ee36-4985-b376-1cc2b808bbd6 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-359682a1-ee36-4985-b376-1cc2b808bbd6 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014134 May 01 22:29:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Mon May 1 22:29:56 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-1b02e424-d90b-46e4-a81b-987192465e5b tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Calling method '.version_select at 0x7fc705eea320>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:29:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-1b02e424-d90b-46e4-a81b-987192465e5b tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] HTTP exception thrown: Volume tempest-invalid-1575721167 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-1b02e424-d90b-46e4-a81b-987192465e5b tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:56 user devstack@n-api.service[61364]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1575721167 HTTP/1.1 May 01 22:29:56 user devstack@n-api.service[61364]: Accept: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:29:56 user devstack@n-api.service[61364]: Connection: close May 01 22:29:56 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:29:56 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:29:56 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:29:56 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:29:56 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:29:56 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: method: May 01 22:29:56 user devstack@n-api.service[61364]: exception: Volume tempest-invalid-1575721167 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: action_args: {'id': 'tempest-invalid-1575721167'} May 01 22:29:56 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1575721167 could not be found. (HTTP 404) (Request-ID: req-c00344a1-6429-4d3b-a58b-5d6fec76d2d3) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1575721167 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1575721167 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1575721167 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-1b02e424-d90b-46e4-a81b-987192465e5b tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 404 to user: Volume tempest-invalid-1575721167 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-1b02e424-d90b-46e4-a81b-987192465e5b tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1575721167" status: 404 len: 99 microversion: 2.1 time: 0.408803 May 01 22:29:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Mon May 1 22:29:56 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1575721167 => generated 99 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2ef468c8-8e85-43a8-924d-34d62fe644df tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005577 May 01 22:29:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Mon May 1 22:29:56 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c566c26b-01cb-4622-9072-f7658f7bd1b7 tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006193 May 01 22:29:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Mon May 1 22:29:56 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-46554912-1449-48f9-b291-fb8d322598fa tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Calling method '.version_select at 0x7fc705392cb0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:29:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-46554912-1449-48f9-b291-fb8d322598fa tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] HTTP exception thrown: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-46554912-1449-48f9-b291-fb8d322598fa tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:56 user devstack@n-api.service[61364]: request: DELETE /compute/v2.1/os-volumes/9b7b2af1-b20c-411f-9f9b-790320e10f13 HTTP/1.1 May 01 22:29:56 user devstack@n-api.service[61364]: Accept: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:29:56 user devstack@n-api.service[61364]: Connection: close May 01 22:29:56 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:29:56 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:29:56 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:29:56 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:29:56 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:29:56 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:29:56 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:29:56 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:29:56 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:56 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:56 user devstack@n-api.service[61364]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:56 user devstack@n-api.service[61364]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:56 user devstack@n-api.service[61364]: method: May 01 22:29:56 user devstack@n-api.service[61364]: exception: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: action_args: {'id': '9b7b2af1-b20c-411f-9f9b-790320e10f13'} May 01 22:29:56 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. (HTTP 404) (Request-ID: req-0908ba4f-1101-41a4-aa43-c9e7ff7567f1) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. May 01 22:29:56 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:29:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-46554912-1449-48f9-b291-fb8d322598fa tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 404 to user: Volume 9b7b2af1-b20c-411f-9f9b-790320e10f13 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-46554912-1449-48f9-b291-fb8d322598fa tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9b7b2af1-b20c-411f-9f9b-790320e10f13" status: 404 len: 109 microversion: 2.1 time: 0.035785 May 01 22:29:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:29:56 2023] DELETE /compute/v2.1/os-volumes/9b7b2af1-b20c-411f-9f9b-790320e10f13 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:29:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-74388b62-6790-409c-a5f8-1961855e60ca tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Calling method '.version_select at 0x7fc7056ab520>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:29:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-74388b62-6790-409c-a5f8-1961855e60ca tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] HTTP exception thrown: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. May 01 22:29:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-74388b62-6790-409c-a5f8-1961855e60ca tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Request method failure captured: May 01 22:29:57 user devstack@n-api.service[61365]: request: GET /compute/v2.1/os-volumes/4f3e4178-f35a-44fe-a533-81126863193c HTTP/1.1 May 01 22:29:57 user devstack@n-api.service[61365]: Accept: application/json May 01 22:29:57 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:29:57 user devstack@n-api.service[61365]: Connection: close May 01 22:29:57 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:29:57 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:29:57 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:29:57 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:29:57 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:29:57 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1jmMxlnQxCRbnAwPTbjatQB-2lf4_yx5t05ZMRMA1bmXo34qpm0O9fOpIrhO3adGyoaGpxAtCd3k36MZaeZY5W994sOvaas28smXCabpND-CSBw10DqeLietH6ZS56yBAgrAExhuMAspGLS6iMagcNCBFHY2M7TqGhxXyEEBTxREs May 01 22:29:57 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:29:57 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:29:57 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:29:57 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:29:57 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:29:57 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:29:57 user devstack@n-api.service[61365]: X-Project-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:57 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:57 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:29:57 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:29:57 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c30a775f8a6f48eca2f8a467eba45487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:29:57 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesNegativeTest-1348543315 May 01 22:29:57 user devstack@n-api.service[61365]: X-Tenant-Id: c30a775f8a6f48eca2f8a467eba45487 May 01 22:29:57 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesNegativeTest-1348543315 May 01 22:29:57 user devstack@n-api.service[61365]: X-User: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:57 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:29:57 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:29:57 user devstack@n-api.service[61365]: X-User-Id: 6f6f8cf1c52244fea3238ecddc6c4aba May 01 22:29:57 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesNegativeTest-1348543315-project-member May 01 22:29:57 user devstack@n-api.service[61365]: method: May 01 22:29:57 user devstack@n-api.service[61365]: exception: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. May 01 22:29:57 user devstack@n-api.service[61365]: action_args: {'id': '4f3e4178-f35a-44fe-a533-81126863193c'} May 01 22:29:57 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. (HTTP 404) (Request-ID: req-30863032-3ae8-45c3-84e5-7cf1968ff015) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. May 01 22:29:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:29:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-74388b62-6790-409c-a5f8-1961855e60ca tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] Returning 404 to user: Volume 4f3e4178-f35a-44fe-a533-81126863193c could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:29:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-74388b62-6790-409c-a5f8-1961855e60ca tempest-VolumesNegativeTest-1348543315 tempest-VolumesNegativeTest-1348543315-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4f3e4178-f35a-44fe-a533-81126863193c" status: 404 len: 109 microversion: 2.1 time: 0.414872 May 01 22:29:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:29:56 2023] GET /compute/v2.1/os-volumes/4f3e4178-f35a-44fe-a533-81126863193c => generated 109 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:30:05 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1892247014", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "f27f032e-fa2a-441a-9fe4-d6566aff8024"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:05 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] validate_networks() for [('f27f032e-fa2a-441a-9fe4-d6566aff8024', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:30:07 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-349c4be5-7a62-416b-ab8f-e97d3067c401 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Action: 'create', calling method: .version_select at 0x7fc705392e60>, body: {"keypair": {"name": "tempest-keypair-1806049068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWqddfcopx/A0JY20IEXtCWD2WxkDCG7ii/jJpjKpFNwW23CNX2KihBkLnwIelRs4Knx1M2BEAxqm2tCGuzHPYsocYJfsXjFwPuRGIo8KuS0rIZN6K5yoZfX/5u1CNc6Q=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:07 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-349c4be5-7a62-416b-ab8f-e97d3067c401 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for project 52f36d96876e417789670fcba7eaae47. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:07 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-349c4be5-7a62-416b-ab8f-e97d3067c401 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for user 0571539c56f1431883cdae05ae7f99e9 and project 52f36d96876e417789670fcba7eaae47. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:07 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-349c4be5-7a62-416b-ab8f-e97d3067c401 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379163 May 01 22:30:07 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:30:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Getting quotas for project 67a532a0c33c468e9cd8b51a38433806. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Getting quotas for user f556db30c55340408604641600ed4ace and project 67a532a0c33c468e9cd8b51a38433806. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:30:08 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:30:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-3b56b53f-99de-4520-8d9a-8ac5061d6619 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.866323 May 01 22:30:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:30:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 3868 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:30:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-763ae6e2-a403-4a0e-8f16-209181bddab9 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-763ae6e2-a403-4a0e-8f16-209181bddab9 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:30:09 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-763ae6e2-a403-4a0e-8f16-209181bddab9 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f556db30c55340408604641600ed4ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a532a0c33c468e9cd8b51a38433806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:30:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-763ae6e2-a403-4a0e-8f16-209181bddab9 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2" status: 200 len: 1209 microversion: 2.1 time: 0.147449 May 01 22:30:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:30:08 2023] GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:30:10 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2048905642", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0ed19f71-826a-4f72-a8ed-ab8cfb981bb7"}], "security_groups": [{"name": "tempest-securitygroup--1793876089"}], "key_name": "tempest-keypair-1806049068", "user_data": "}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:10 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] validate_networks() for [('0ed19f71-826a-4f72-a8ed-ab8cfb981bb7', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for project 52f36d96876e417789670fcba7eaae47. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for user 0571539c56f1431883cdae05ae7f99e9 and project 52f36d96876e417789670fcba7eaae47. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:30:12 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:30:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-c4df4d82-d51c-4f95-bcb3-67747a59f019 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.132924 May 01 22:30:12 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:30:10 2023] POST /compute/v2.1/servers => generated 400 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:30:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c12ce0f1-eecc-4482-892e-f55d1fc66ac9 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:12 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c12ce0f1-eecc-4482-892e-f55d1fc66ac9 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:30:12 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c12ce0f1-eecc-4482-892e-f55d1fc66ac9 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:30:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c12ce0f1-eecc-4482-892e-f55d1fc66ac9 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 200 len: 1232 microversion: 2.1 time: 0.186320 May 01 22:30:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:30:12 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 1232 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Creating event network-changed:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-551144ee-d6c8-408f-8bda-2932bb88cd60 req-dbe6433a-106f-4a45-8e76-41c777e4dcda service nova] Acquired lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:18 user devstack@n-api.service[61365]: INFO nova.compute.rpcapi [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Automatically selected compute RPC version 6.2 from minimum service version 66 May 01 22:30:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] Releasing lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} May 01 22:30:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-86cdd86b-feb7-4b8b-9c39-fc4e6f3f25dc None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257646 May 01 22:30:18 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:19 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Creating event network-changed:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-9dbd8ee1-ea35-400e-8871-b6c63889b885 req-cb8a3bcb-3f5e-415d-aca5-c5d6233fc001 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:19 user devstack@n-api.service[61364]: INFO nova.compute.rpcapi [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Automatically selected compute RPC version 6.2 from minimum service version 66 May 01 22:30:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] Releasing lock "compute-rpcapi-router" {{(pid=61364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} May 01 22:30:19 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-7904e909-dca7-464d-bbc7-cef8a23b363c None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222188 May 01 22:30:19 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "name": "network-vif-plugged", "status": "completed", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:25 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Creating event network-vif-plugged:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c3892989-420d-4034-83ec-7136aca993b3 req-674242dd-731b-4945-be52-b5330602e8ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:25 user devstack@n-api.service[61366]: INFO nova.compute.rpcapi [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 May 01 22:30:25 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] Releasing lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} May 01 22:30:25 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-25df37a0-755a-45b4-8d83-3fce8b2cbe53 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111964 May 01 22:30:25 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:27 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:27 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=10 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:27 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "name": "network-vif-plugged", "status": "completed", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}, {"server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "name": "network-vif-plugged", "status": "completed", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Creating event network-vif-plugged:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:30:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] Creating event network-vif-plugged:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:30:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-d9fbf904-40bd-4fd8-a8d8-03e198a543e2 req-5885d94a-b780-4125-8484-a444b623816b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048368 May 01 22:30:27 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:30:27 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-21e82a86-2242-4a30-bfe7-85d64d78980e tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Action: 'create', calling method: .version_select at 0x7fc705281c60>, body: {"keypair": {"name": "tempest-keypair-327918259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9FBIusZC/1k+FTgzJtedyUKqcU5xc8Qs+VWdf2aayEcGy9BHCjwCbH0c6oKMINnCBEClqS4w21YRmN2UsHHG0kgVNBC3uPJ8unYuUjcuTRNZJMlOTHx5za5YiVpK8wUQ=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:27 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-21e82a86-2242-4a30-bfe7-85d64d78980e tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:27 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-21e82a86-2242-4a30-bfe7-85d64d78980e tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for user fbcde31ec47741d1ac197046bc3aa999 and project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:27 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-21e82a86-2242-4a30-bfe7-85d64d78980e tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.466532 May 01 22:30:27 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 22/63] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:30:27 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "name": "network-vif-plugged", "status": "completed", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] Creating event network-vif-plugged:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:30:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-f1b1729b-e5c8-47c0-85e4-c98d6df9fd5f req-2e3e2139-2a1d-4d86-84a1-50480e4e6b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054001 May 01 22:30:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1452819190", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "931f53e7-e5b1-4b04-a6e0-cbd3107ee682"}], "security_groups": [{"name": "tempest-securitygroup--1405245471"}], "key_name": "tempest-keypair-327918259", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] validate_networks() for [('931f53e7-e5b1-4b04-a6e0-cbd3107ee682', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:34 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:35 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for user fbcde31ec47741d1ac197046bc3aa999 and project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:35 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:30:35 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:30:35 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-4d3435bf-5e84-4bc3-8eff-758e7b3ae31c tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.012833 May 01 22:30:35 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:30:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:30:35 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:35 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:35 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fa454303-1788-46e5-a0e5-098c9514fd83 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-fa454303-1788-46e5-a0e5-098c9514fd83 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:30:35 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-fa454303-1788-46e5-a0e5-098c9514fd83 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:30:35 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fa454303-1788-46e5-a0e5-098c9514fd83 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767" status: 200 len: 1235 microversion: 2.1 time: 0.309224 May 01 22:30:35 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:30:35 2023] GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 => generated 1235 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:30:37 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:37 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-1dc10868-14f1-4568-8631-d11dcef5ad78 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Action: 'create', calling method: .version_select at 0x7fc704a80c10>, body: {"keypair": {"name": "tempest-keypair-1562908744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA80wwkkwnsCVGxBK3tnyQsAIFZkYhveDJKiip482oV4SN/ZzdTxCMG3jeQiGl83zt43OMA/ZYGHQLweOEYGeI86izFyfP0gGUL0n73/8PYDvycwmHDQx+dW/EMJhNO0bA=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:37 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-1dc10868-14f1-4568-8631-d11dcef5ad78 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Getting quotas for project acefa8bb65a94b25ada784bb805a5cdf. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:37 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-1dc10868-14f1-4568-8631-d11dcef5ad78 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Getting quotas for user 4318273f32ca4ef0a59e80f4a0c07a6e and project acefa8bb65a94b25ada784bb805a5cdf. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:37 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-1dc10868-14f1-4568-8631-d11dcef5ad78 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.499290 May 01 22:30:37 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:30:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:30:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-dfed0cbb-39bd-4b70-83a1-4c3d2247f062 tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] Action: 'create', calling method: .version_select at 0x7fc704933640>, body: {"keypair": {"name": "tempest-TestShelveInstance-278709189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELDkXDe0ibFfMhd2WPZAJVBzldjQ3vb9aaWxbmMTir7nsCJDVOuvZYvG62FuAnwE6svRXSk1pX/eFQBUej/C0J0n6ePod+9UH/2HwH9fRsp1p8mOH2unzVcp1+aX5PvmA=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:38 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:38 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-dfed0cbb-39bd-4b70-83a1-4c3d2247f062 tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] Getting quotas for project 250e6cefbbe24cf689c0f78d105c4d98. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:38 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-dfed0cbb-39bd-4b70-83a1-4c3d2247f062 tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] Getting quotas for user b64ddcea93c7475096b3d7a0ef3e3f03 and project 250e6cefbbe24cf689c0f78d105c4d98. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:38 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-dfed0cbb-39bd-4b70-83a1-4c3d2247f062 tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.222990 May 01 22:30:38 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:30:38 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:41 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] Creating event network-changed:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:30:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-03c61fa3-1f4e-4a16-827d-241419d0aab2 req-3f04c785-98f7-4d59-a30d-b92036b96011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035032 May 01 22:30:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:42 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-366398376", "imageRef": "4d17a87f-1a78-4043-becb-d88851818069", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e15b8fe8-6847-4288-ad0f-5624be695661"}], "security_groups": [{"name": "tempest-securitygroup--732256196"}], "key_name": "tempest-keypair-1562908744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:42 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:42 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] validate_networks() for [('e15b8fe8-6847-4288-ad0f-5624be695661', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Getting quotas for project acefa8bb65a94b25ada784bb805a5cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Getting quotas for user 4318273f32ca4ef0a59e80f4a0c07a6e and project acefa8bb65a94b25ada784bb805a5cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:30:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d17a87f-1a78-4043-becb-d88851818069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:30:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-28ca56d9-870e-4ce9-b4f4-717c7b09c792 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.493045 May 01 22:30:43 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:30:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:30:43 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-0fe14911-f298-414b-b342-f5d415ba24a2 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:43 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-0fe14911-f298-414b-b342-f5d415ba24a2 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:30:43 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-0fe14911-f298-414b-b342-f5d415ba24a2 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318273f32ca4ef0a59e80f4a0c07a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acefa8bb65a94b25ada784bb805a5cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:30:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-0fe14911-f298-414b-b342-f5d415ba24a2 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 200 len: 1239 microversion: 2.1 time: 0.119417 May 01 22:30:43 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:30:43 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:30:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "name": "network-vif-plugged", "status": "completed", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] Creating event network-vif-plugged:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:30:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-4826b7f9-9abe-4094-a234-ae024c533726 req-2918b29c-474b-4f4e-8def-4bc933ca6a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222635 May 01 22:30:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-db5f23a9-20d8-4975-9854-cedae1ebfb3f tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] Calling method '.version_select at 0x7fc704a82050>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-db5f23a9-20d8-4975-9854-cedae1ebfb3f tempest-TestShelveInstance-856141932 tempest-TestShelveInstance-856141932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-278709189" status: 202 len: 0 microversion: 2.1 time: 0.030917 May 01 22:30:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 24/73] 10.0.0.210 () {62 vars in 1328 bytes} [Mon May 1 22:30:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-278709189 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "name": "network-vif-plugged", "status": "completed", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=10 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:47 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:47 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] Creating event network-vif-plugged:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:30:47 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-15b3db94-2bdf-43d7-a8d9-b86421831d57 req-52ec39f8-7381-4a4f-a1f9-7b5147081abc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045807 May 01 22:30:47 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] Creating event network-changed:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:30:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-eebfbe39-5359-484d-ae1d-92554df9529d req-f17ea7d1-74ad-47b8-8bd2-6b36e077a181 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039237 May 01 22:30:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "name": "network-vif-plugged", "status": "completed", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] Creating event network-vif-plugged:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:30:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-22623fbe-66b7-424b-963b-4d06c10264d6 req-ac0d9e31-0441-4c03-be8e-c6af1b68aedf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040644 May 01 22:30:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=12 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:30:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "name": "network-vif-plugged", "status": "completed", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:30:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] Creating event network-vif-plugged:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:30:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-4c8b685f-7751-4698-89fe-bb7669090432 req-9d3da766-d29c-4652-bf26-2fca99a0772b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 May 01 22:30:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:30:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:30:59 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f556db30c55340408604641600ed4ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a532a0c33c468e9cd8b51a38433806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:30:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-94d73a55-94cf-4381-a2fc-aa03203c74d0 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2" status: 200 len: 1490 microversion: 2.1 time: 0.534859 May 01 22:30:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 27/78] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:30:59 2023] GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 => generated 1490 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:03 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a11f5484-2d59-4730-9f3e-e0f77a12ba3b tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 200 len: 1537 microversion: 2.1 time: 1.148988 May 01 22:31:03 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:02 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 1537 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-268724366", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "7b537d45-40a4-4b68-9af9-58d63dce9c7b"}]}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] validate_networks() for [('7b537d45-40a4-4b68-9af9-58d63dce9c7b', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for user d69bdbfb4f5844e1a5048ea211f81ac4 and project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:31:04 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:31:05 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e72c6e67-a24d-4628-ad67-dc9a02ebcc7a tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.790500 May 01 22:31:05 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 27/80] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:31:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:31:05 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:05 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:05 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:05 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:05 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:05 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-129b28ec-fa82-4f33-a71b-32d2870b696b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 200 len: 1394 microversion: 2.87 time: 0.116479 May 01 22:31:05 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:31:05 2023] GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 1394 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:31:05 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-80a0c339-a24a-4fc8-88cb-68fa5df3fdb9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Action: 'create', calling method: .version_select at 0x7fc704a81630>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1488907423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdrlNWNC7/LpwP0dikKT92d/1OLj7X+5N2e80uYyZ6RO2RF2U0/0YOSoYw0g8vn7ydbkZo5sLkHAkHewk+MXwuBMOg1m2bIi8c7ZCP+sCpYa9MFPD+lttdnllR7A2q1JA=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:05 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-80a0c339-a24a-4fc8-88cb-68fa5df3fdb9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for project b7cbab6c671b408a8807b15ba4319111. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:05 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-80a0c339-a24a-4fc8-88cb-68fa5df3fdb9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for user 4eeaf3e2d4ae4d94847b9cb1266ae307 and project b7cbab6c671b408a8807b15ba4319111. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-80a0c339-a24a-4fc8-88cb-68fa5df3fdb9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060422 May 01 22:31:05 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 27/82] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:31:05 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:05 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1913846708", "imageRef": "96073c9b-42ff-4f02-97a1-47a64969d990", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1488907423", "networks": [{"uuid": "1248f1c5-ebea-4d21-8867-928f631ce8cf"}]}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:05 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] validate_networks() for [('1248f1c5-ebea-4d21-8867-928f631ce8cf', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for project b7cbab6c671b408a8807b15ba4319111. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for user 4eeaf3e2d4ae4d94847b9cb1266ae307 and project b7cbab6c671b408a8807b15ba4319111. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:31:06 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='96073c9b-42ff-4f02-97a1-47a64969d990',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:31:06 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-54efadd6-7109-4db3-9558-13b031a6d54a tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.747057 May 01 22:31:06 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 28/83] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:31:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:31:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1648f330-cdda-41e4-8477-69a8932a7fcb tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:06 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-1648f330-cdda-41e4-8477-69a8932a7fcb tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:06 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-1648f330-cdda-41e4-8477-69a8932a7fcb tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1648f330-cdda-41e4-8477-69a8932a7fcb tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 200 len: 1253 microversion: 2.1 time: 0.080849 May 01 22:31:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 29/84] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:06 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:31:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] Creating event network-changed:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:31:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-cc3c12da-3d29-4df0-b192-cf240e822394 req-bfd3bd74-2b18-4dad-9e58-70881f4151c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040579 May 01 22:31:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:11 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:11 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=7 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:11 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] Creating event network-changed:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:31:11 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-b8fe7bae-99f8-45bb-a4a2-bb83ec0b601b req-ff1cde67-6e37-4188-8b75-eff53a33d081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120999 May 01 22:31:11 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:11 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=12 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-836c9c53-b0a9-48fe-89f9-972d1a3da777 tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] Action: 'create', calling method: .version_select at 0x7fc704948a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-251542717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7IYWFC+pDPBbHf0uUDkCvcy/lsxCaWz6bb8AeN4IBx/WHu/n7JDOU8agthz/49/dMgkxbdoq4fk5MQeMyaPnAlajmxPND10sFjDXvnS0r82JBrZI3UOrclMwCWWIRXCQ=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:11 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=18 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:11 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-836c9c53-b0a9-48fe-89f9-972d1a3da777 tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] Getting quotas for project 17a0daa2a228456daed39024858d5d5b. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:11 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-836c9c53-b0a9-48fe-89f9-972d1a3da777 tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] Getting quotas for user 0705f39969b74360bf9d8a559ea50d09 and project 17a0daa2a228456daed39024858d5d5b. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-836c9c53-b0a9-48fe-89f9-972d1a3da777 tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.072032 May 01 22:31:11 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 30/87] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:31:11 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "name": "network-vif-plugged", "status": "completed", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] Creating event network-vif-plugged:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:31:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-cd73d943-97da-490f-8083-118804252d55 req-210e6595-2bdb-4525-916c-616c6f65b4ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049253 May 01 22:31:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 29/88] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "name": "network-vif-plugged", "status": "completed", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] Creating event network-vif-plugged:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:31:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-522efc62-73b5-4113-9ea3-22a3202ed822 req-abd4c0de-280d-40de-a321-8eb0ab0e87a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053820 May 01 22:31:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:14 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:31:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-b9725e2d-71c8-4a7c-8ad6-d4d43aeecef1 req-eace2e82-179c-4f0d-8c8e-111bf046ef54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041246 May 01 22:31:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:14 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7b3f16fe-20df-4125-b963-9aed523f83f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Action: 'create', calling method: .version_select at 0x7fc704aef250>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-339213469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFDpikSqKZ1XcPA+GjRJe3dTbt1An8l5YUMuSRznFv4AedZY4p+YUN2grlxzkR+v76FMTaAgguxiwJjPp2GA0EeOBnimNFRhXYCueaIJvxsFrITUHLfBDUaPT24np/rqA=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:14 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-7b3f16fe-20df-4125-b963-9aed523f83f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Getting quotas for project 5feedabacbf648ad86bbe223d09710dd. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:14 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-7b3f16fe-20df-4125-b963-9aed523f83f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Getting quotas for user f7ac657f9b694e04872f9209eea31e9d and project 5feedabacbf648ad86bbe223d09710dd. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:14 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-7b3f16fe-20df-4125-b963-9aed523f83f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.250916 May 01 22:31:14 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:31:14 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:15 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-86d3d9fd-1ca5-45f5-8340-d1e9dc05635f tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] Calling method '.version_select at 0x7fc704932cb0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:15 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-86d3d9fd-1ca5-45f5-8340-d1e9dc05635f tempest-TestVolumeBootPattern-577822570 tempest-TestVolumeBootPattern-577822570-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-251542717" status: 202 len: 0 microversion: 2.1 time: 0.029244 May 01 22:31:15 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 31/92] 10.0.0.210 () {62 vars in 1337 bytes} [Mon May 1 22:31:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-251542717 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:31:16 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1455089382", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-339213469", "security_groups": [{"name": "tempest-secgroup-smoke-1198370435"}], "networks": [{"uuid": "1ef47b0c-2ea4-4e8c-b94f-9d3fea83b0eb"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:16 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:16 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:31:16 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-9166bed7-5c5a-47f0-a57a-c2091db026f0 req-33caae4f-0e43-4ed7-bf1e-84ab1cff4fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 May 01 22:31:16 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:16 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] validate_networks() for [('1ef47b0c-2ea4-4e8c-b94f-9d3fea83b0eb', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Getting quotas for project 5feedabacbf648ad86bbe223d09710dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Getting quotas for user f7ac657f9b694e04872f9209eea31e9d and project 5feedabacbf648ad86bbe223d09710dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:31:17 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:31:17 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b1506184-01fa-4bb2-98a5-b87c4d1656c3 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.123268 May 01 22:31:17 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 32/94] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:31:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:31:17 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:17 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=12 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:17 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e9beec34-b82d-43db-9e8b-5f42ac671cbc tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:17 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e9beec34-b82d-43db-9e8b-5f42ac671cbc tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:17 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-e9beec34-b82d-43db-9e8b-5f42ac671cbc tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ac657f9b694e04872f9209eea31e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5feedabacbf648ad86bbe223d09710dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:17 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e9beec34-b82d-43db-9e8b-5f42ac671cbc tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 200 len: 1256 microversion: 2.1 time: 0.073748 May 01 22:31:17 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:17 2023] GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 1256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:31:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] Creating event network-changed:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:31:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-df5b4a2d-c33a-4940-96cf-011c77b29566 req-181e7a1a-97c7-47c8-b139-2f404a26e997 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233203 May 01 22:31:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:31:23 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "name": "network-vif-plugged", "status": "completed", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] Creating event network-vif-plugged:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:31:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-f2697ef6-b877-49c2-9bc8-b9d5919ce2aa req-0d396bd0-ddc2-44d2-a128-241f4f37f10a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041751 May 01 22:31:23 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=12 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:25 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:25 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e6d07778-74ea-43fa-8d92-68f3ed986c32 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767" status: 200 len: 1544 microversion: 2.1 time: 0.361178 May 01 22:31:25 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 33/98] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:25 2023] GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 => generated 1544 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "name": "network-vif-plugged", "status": "completed", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:26 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] Creating event network-vif-plugged:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:31:26 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-041eca63-c1cc-4a8b-b43b-3df660c81d42 req-70d16a54-f932-4390-8b5a-cd56eafef468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045001 May 01 22:31:26 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:31:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=14 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:34 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318273f32ca4ef0a59e80f4a0c07a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acefa8bb65a94b25ada784bb805a5cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:34 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f3d2e104-3529-4ea7-8684-b17d6832466f tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 200 len: 1548 microversion: 2.1 time: 0.301242 May 01 22:31:34 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:33 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 1548 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4561b6da-8748-4b34-90cd-281d7c5d98da tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] Action: 'create', calling method: .version_select at 0x7fc70495d990>, body: {"keypair": {"name": "tempest-TestStampPattern-2074571057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrGpGeGFTrEp7TijQ5IkjCzZiv5QQgcOL5t4R0F0ter01UC/FKU51VLgGZhUbzvIl1A2Deg9NFS/iozrkkWCkVWZNXsVDvCnLj2Pg4ot/K/4McVOVMfP3e3tpcEeyraPQ=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-4561b6da-8748-4b34-90cd-281d7c5d98da tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] Getting quotas for project 6d03b724862a468090e7191177b6b2c8. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:31:42 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-4561b6da-8748-4b34-90cd-281d7c5d98da tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] Getting quotas for user 6dc84c66f03b4c9ab1e129b020f72f99 and project 6d03b724862a468090e7191177b6b2c8. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:31:42 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-4561b6da-8748-4b34-90cd-281d7c5d98da tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.516350 May 01 22:31:42 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 34/101] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:31:42 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:31:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0f1741a5-0bda-44ba-a8ee-d778b0daa62f tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] Calling method '.version_select at 0x7fc704aec1f0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0f1741a5-0bda-44ba-a8ee-d778b0daa62f tempest-TestStampPattern-2063252470 tempest-TestStampPattern-2063252470-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-2074571057" status: 202 len: 0 microversion: 2.1 time: 0.026244 May 01 22:31:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:31:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-2074571057 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=12 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:55 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-82c60519-ef5b-4ec5-8387-0a8e16b59f6d tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 200 len: 1691 microversion: 2.87 time: 0.491981 May 01 22:31:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 35/103] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:31:55 2023] GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 1691 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:31:56 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:31:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-70c579f1-4cb6-4da7-9484-34f6cc015334 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 200 len: 1535 microversion: 2.1 time: 0.249987 May 01 22:31:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:31:56 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 1535 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:32:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5fff11c9-1d8e-4f21-b1e8-9750193253ca tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2" status: 204 len: 0 microversion: 2.1 time: 0.186121 May 01 22:32:01 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:32:01 2023] DELETE /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:01 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f556db30c55340408604641600ed4ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a532a0c33c468e9cd8b51a38433806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-58a75653-9d5e-435b-a6e2-d773e79d7c6d tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2" status: 200 len: 1496 microversion: 2.1 time: 0.299234 May 01 22:32:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:01 2023] GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 => generated 1496 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:01 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "name": "network-vif-unplugged", "status": "completed", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] Creating event network-vif-unplugged:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:32:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-74c260ba-9646-45ec-a61f-15fe080406a7 req-ef6e7f58-0369-4350-b203-48747bd80709 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038525 May 01 22:32:01 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:32:03 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "name": "network-vif-plugged", "status": "completed", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}, {"server_uuid": "49156968-db4d-4231-96a5-cf4fb9c0cde2", "name": "network-vif-deleted", "tag": "4025562c-2381-4896-8b53-6ea2d9d876f2"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Creating event network-vif-plugged:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:32:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] Creating event network-vif-deleted:4025562c-2381-4896-8b53-6ea2d9d876f2 for instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 on user May 01 22:32:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-b7ec128a-7038-4958-b574-baf973956288 req-940d1b10-7c3f-4cf9-98de-9dabe979984e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035067 May 01 22:32:03 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9f6ebe40-e6df-4aa3-812c-bc0c82f7d648 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.270340 May 01 22:32:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:32:03 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3/os-interface => generated 282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:05 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:05 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] Creating event network-changed:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:32:05 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-e18291d8-cd74-4bc8-bf49-1dc4e65de0c8 req-00bd5f11-cf7d-491d-8172-27afd1ec80a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028796 May 01 22:32:05 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d476d9f5-6cd6-43be-8879-dddeefbc0c30 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3/ips" status: 200 len: 103 microversion: 2.1 time: 0.039608 May 01 22:32:05 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:32:05 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3/ips => generated 103 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:32:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dffdcd23-211b-46d5-a0b9-03cae3c7a2cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 204 len: 0 microversion: 2.1 time: 0.143174 May 01 22:32:07 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:32:07 2023] DELETE /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "name": "network-vif-unplugged", "status": "completed", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] Creating event network-vif-unplugged:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:32:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9fdeb718-33bc-4276-9b10-5b628a03990c req-ec069738-689f-4f80-92e7-15afdd95f42a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035298 May 01 22:32:07 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:07 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:07 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-ba740592-0b94-483c-9b31-3ae6e3758753 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 200 len: 1661 microversion: 2.1 time: 0.290692 May 01 22:32:07 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:07 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 1661 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:07 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ac657f9b694e04872f9209eea31e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5feedabacbf648ad86bbe223d09710dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c8a1a207-dbb3-40ee-b47a-8ecc9187228c tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 200 len: 1569 microversion: 2.1 time: 0.257841 May 01 22:32:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:07 2023] GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:09 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "name": "network-vif-plugged", "status": "completed", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}, {"server_uuid": "8c22a392-d145-4477-81d1-b5d3f3c599f3", "name": "network-vif-deleted", "tag": "0a3b4673-af97-4d40-b82e-b9e8572125b8"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Creating event network-vif-plugged:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:32:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] Creating event network-vif-deleted:0a3b4673-af97-4d40-b82e-b9e8572125b8 for instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 on user May 01 22:32:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-cc018190-5ea9-4640-bbcf-1d78dda98acf req-a40df651-2622-427b-94ca-b931059457c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032929 May 01 22:32:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=16 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:26 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-f957a3bd-94fa-4119-b52d-fba0f3d21c52 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.433314 May 01 22:32:26 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 39/117] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:32:25 2023] GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767/os-interface => generated 282 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:27 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] Creating event network-changed:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:32:27 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4236972b-bbdb-455b-bae8-92ae62e8d195 req-a67512c6-d2f0-400d-a498-671c6bd9c9ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036577 May 01 22:32:27 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1057931638", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "931f53e7-e5b1-4b04-a6e0-cbd3107ee682"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] validate_networks() for [('931f53e7-e5b1-4b04-a6e0-cbd3107ee682', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Getting quotas for user fbcde31ec47741d1ac197046bc3aa999 and project 75ef8c62d77b49e18c37c546261d4f27. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:32:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:32:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0102cbf5-5cbb-44b5-bf44-323d8bdab231 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.590969 May 01 22:32:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 41/119] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:32:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:32:29 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-363f7b60-8407-43c6-b0d7-bdd0b52bc7c2 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:29 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-363f7b60-8407-43c6-b0d7-bdd0b52bc7c2 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:29 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-363f7b60-8407-43c6-b0d7-bdd0b52bc7c2 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:29 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-363f7b60-8407-43c6-b0d7-bdd0b52bc7c2 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0" status: 200 len: 1212 microversion: 2.1 time: 0.077184 May 01 22:32:29 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:29 2023] GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:32 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] Creating event network-changed:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:32:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-ea9f33ed-ea83-4647-a5a3-42f4b2482238 req-3b4c79d4-8616-45a7-acd4-a4af7aa015ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029055 May 01 22:32:32 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:34 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "name": "network-vif-plugged", "status": "completed", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:34 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] Creating event network-vif-plugged:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:32:34 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-5a20390c-882b-4327-a9be-b3521fa0341f req-0d5229b0-1378-4247-a5cc-b0540ee92e7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029995 May 01 22:32:34 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:34 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-f6d25f99-970b-46b0-ae3e-dccb06225be1 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.178346 May 01 22:32:34 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:32:34 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c/os-interface => generated 283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:35 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] Creating event network-changed:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:32:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a6a66bde-9ff0-43dd-98d5-2cde4b526414 req-b024cdd3-1585-4ffd-b114-75bf6744dbd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029026 May 01 22:32:35 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "name": "network-vif-plugged", "status": "completed", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] Creating event network-vif-plugged:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:32:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-dd374ddb-78d9-4cb2-84d2-f5947ebea065 req-00b10257-6753-4a00-a870-4f965da300cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028989 May 01 22:32:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 43/125] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:36 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:32:36 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-b5c5ee42-bfb0-423d-8526-171cf98ebbc8 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 204 len: 0 microversion: 2.1 time: 0.275871 May 01 22:32:36 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 42/126] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:32:36 2023] DELETE /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:37 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318273f32ca4ef0a59e80f4a0c07a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acefa8bb65a94b25ada784bb805a5cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:37 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2672cdb4-f8f8-442c-881b-25fdd8873cbf tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 200 len: 1673 microversion: 2.1 time: 0.321467 May 01 22:32:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "name": "network-vif-unplugged", "status": "completed", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:37 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:36 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 1673 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:32:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] Creating event network-vif-unplugged:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:32:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-5d065292-7c42-4cf9-982c-45ccacf1631b req-6f070dd4-c3c2-468c-95b0-7eec386671ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037579 May 01 22:32:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:38 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "name": "network-vif-deleted", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:38 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:38 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] Creating event network-vif-deleted:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:32:38 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-6f8be345-f65f-4ecd-9256-ae9fd343acb7 req-ad7e8527-3912-41fb-bd74-a1750dae0479 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034080 May 01 22:32:38 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ded3b8-a7b4-4ce7-9961-905cd4c45d7c", "name": "network-vif-plugged", "status": "completed", "tag": "78f662d2-bff8-4fd7-99f0-48a47395bd54"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] Creating event network-vif-plugged:78f662d2-bff8-4fd7-99f0-48a47395bd54 for instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c on user May 01 22:32:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-6092c405-fe78-4ae8-b56f-0822fb79e813 req-e068ce10-3b6a-4288-85b5-987b994f2ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 May 01 22:32:39 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] [instance: 49156968-db4d-4231-96a5-cf4fb9c0cde2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] HTTP exception thrown: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Request method failure captured: May 01 22:32:51 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 HTTP/1.1 May 01 22:32:51 user devstack@n-api.service[61365]: Accept: application/json May 01 22:32:51 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:32:51 user devstack@n-api.service[61365]: Connection: close May 01 22:32:51 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:32:51 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:32:51 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:32:51 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:32:51 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:32:51 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1seifNgvtEHfHZEY2HBKc5K8aKWLuJHA3Lfi0zZsOpujxJRLpzRV0I9b_zLpuA81UMF8REGIUBHmq6qfAaUf9GqRdhjtDjoURdgYhPXYVt0yS0RoKFydxAWlI_Sti-si-T6YeTbgaRFwRJ73_928J9N_i8gKZwKDiMQLfyiRPtaag May 01 22:32:51 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:32:51 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:32:51 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:32:51 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:32:51 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:32:51 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:32:51 user devstack@n-api.service[61365]: X-Project-Id: 67a532a0c33c468e9cd8b51a38433806 May 01 22:32:51 user devstack@n-api.service[61365]: X-Project-Name: tempest-DeleteServersTestJSON-140421605 May 01 22:32:51 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:32:51 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:32:51 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67a532a0c33c468e9cd8b51a38433806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/67a532a0c33c468e9cd8b51a38433806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67a532a0c33c468e9cd8b51a38433806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:32:51 user devstack@n-api.service[61365]: X-Tenant: tempest-DeleteServersTestJSON-140421605 May 01 22:32:51 user devstack@n-api.service[61365]: X-Tenant-Id: 67a532a0c33c468e9cd8b51a38433806 May 01 22:32:51 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-DeleteServersTestJSON-140421605 May 01 22:32:51 user devstack@n-api.service[61365]: X-User: tempest-DeleteServersTestJSON-140421605-project-member May 01 22:32:51 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:32:51 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:32:51 user devstack@n-api.service[61365]: X-User-Id: f556db30c55340408604641600ed4ace May 01 22:32:51 user devstack@n-api.service[61365]: X-User-Name: tempest-DeleteServersTestJSON-140421605-project-member May 01 22:32:51 user devstack@n-api.service[61365]: method: > May 01 22:32:51 user devstack@n-api.service[61365]: exception: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. May 01 22:32:51 user devstack@n-api.service[61365]: action_args: {'id': '49156968-db4d-4231-96a5-cf4fb9c0cde2'} May 01 22:32:51 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. May 01 22:32:51 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:32:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] Returning 404 to user: Instance 49156968-db4d-4231-96a5-cf4fb9c0cde2 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:32:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-96cd23b3-2378-4b90-ac3c-4e752e708d98 tempest-DeleteServersTestJSON-140421605 tempest-DeleteServersTestJSON-140421605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2" status: 404 len: 111 microversion: 2.1 time: 0.041944 May 01 22:32:51 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 45/131] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:51 2023] GET /compute/v2.1/servers/49156968-db4d-4231-96a5-cf4fb9c0cde2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1815591082"}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-21f208a3-34dd-4686-9db7-02abf8e08018 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7/action" status: 202 len: 52 microversion: 2.87 time: 0.882313 May 01 22:32:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 44/132] 10.0.0.210 () {66 vars in 1396 bytes} [Mon May 1 22:32:55 2023] POST /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7/action => generated 52 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=14 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-13a58041-1a84-43bc-ac89-6a5684aaa6bd tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 200 len: 1535 microversion: 2.1 time: 0.284250 May 01 22:32:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:57 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 1535 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Searching by: {'deleted': False, 'project_id': 'b7cbab6c671b408a8807b15ba4319111'} {{(pid=61365) get_all /opt/stack/nova/nova/compute/api.py:3019}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG nova.compute.multi_cell_list [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 01 22:32:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-7154e822-b29b-444d-8b55-5301c74dba09 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.217639 May 01 22:32:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1202 bytes} [Mon May 1 22:32:57 2023] GET /compute/v2.1/servers => generated 341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:32:57 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 HTTP/1.1 May 01 22:32:57 user devstack@n-api.service[61364]: Accept: application/json May 01 22:32:57 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:32:57 user devstack@n-api.service[61364]: Connection: close May 01 22:32:57 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:32:57 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:32:57 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:32:57 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:32:57 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:32:57 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:32:57 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:32:57 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:32:57 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:32:57 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:32:57 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:32:57 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:32:57 user devstack@n-api.service[61364]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:32:57 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:32:57 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:32:57 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:32:57 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:32:57 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:32:57 user devstack@n-api.service[61364]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:32:57 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:32:57 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:32:57 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:32:57 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:32:57 user devstack@n-api.service[61364]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:32:57 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:32:57 user devstack@n-api.service[61364]: method: > May 01 22:32:57 user devstack@n-api.service[61364]: exception: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:32:57 user devstack@n-api.service[61364]: action_args: {'id': '8c22a392-d145-4477-81d1-b5d3f3c599f3'} May 01 22:32:57 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:32:57 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:32:57 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:32:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e437fb96-20b1-42eb-9ee0-8916a58c8d62 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 404 len: 111 microversion: 2.1 time: 0.033285 May 01 22:32:57 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:57 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:32:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bd505e83-8553-4472-8708-e91b7054cb06 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '.version_select at 0x7fc7047c7910>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-bd505e83-8553-4472-8708-e91b7054cb06 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806049068" status: 202 len: 0 microversion: 2.1 time: 0.023504 May 01 22:32:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1298 bytes} [Mon May 1 22:32:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806049068 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:32:57 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-7b9280de-9699-4d14-aef3-03559bcd03f5 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 200 len: 1535 microversion: 2.1 time: 0.161040 May 01 22:32:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:57 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:58 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-7aeff1d6-cce5-481a-ac35-b9f4c03de923 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Action: 'create', calling method: .version_select at 0x7fc7047b04c0>, body: {"keypair": {"name": "tempest-keypair-403460319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDTqrJIL9DIuxTF7hTTAZW9hdOB0LjkykdcO8TKqcHuHgN/COFsnjO1CYH+/aUxGo/80m0+TA9kmZ+m99pCF6xsTcgvsaOAReTJqjom6WN6xFQbK2x5FtGPxVAFngrh8A=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:58 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-7aeff1d6-cce5-481a-ac35-b9f4c03de923 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for project 52f36d96876e417789670fcba7eaae47. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:32:58 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-7aeff1d6-cce5-481a-ac35-b9f4c03de923 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for user 0571539c56f1431883cdae05ae7f99e9 and project 52f36d96876e417789670fcba7eaae47. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:32:58 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-7aeff1d6-cce5-481a-ac35-b9f4c03de923 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043820 May 01 22:32:58 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 46/138] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:32:58 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:32:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dafc5002-22c8-403d-b2f0-46c3bcf7acbf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 204 len: 0 microversion: 2.1 time: 0.118372 May 01 22:32:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 48/139] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:32:59 2023] DELETE /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:32:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6077c37d-6e08-4cc1-8615-f630e56ae896 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 200 len: 1541 microversion: 2.1 time: 0.173931 May 01 22:32:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 46/140] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:32:59 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 1541 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:32:59 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-unplugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:32:59 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:32:59 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:32:59 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:32:59 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] Creating event network-vif-unplugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:32:59 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-2ddf8da2-bac1-48a8-98b1-c82f8fe09762 req-7b7fd9dc-e454-4c01-95df-ea97ef711087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028307 May 01 22:32:59 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:32:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:00 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1231658264", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0ed19f71-826a-4f72-a8ed-ab8cfb981bb7"}], "security_groups": [{"name": "tempest-securitygroup--11005660"}], "key_name": "tempest-keypair-403460319", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:00 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] validate_networks() for [('0ed19f71-826a-4f72-a8ed-ab8cfb981bb7', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for project 52f36d96876e417789670fcba7eaae47. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Getting quotas for user 0571539c56f1431883cdae05ae7f99e9 and project 52f36d96876e417789670fcba7eaae47. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:33:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-40535812-f557-4bf4-9f1d-f4e3865cce95 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.791571 May 01 22:33:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 49/142] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:33:00 2023] POST /compute/v2.1/servers => generated 398 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5b632536-8cb4-4155-867a-5aa9739e5c3d tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5b632536-8cb4-4155-867a-5aa9739e5c3d tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-deleted", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-5b632536-8cb4-4155-867a-5aa9739e5c3d tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5b632536-8cb4-4155-867a-5aa9739e5c3d tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 200 len: 1231 microversion: 2.1 time: 0.089452 May 01 22:33:01 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:01 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 1231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}, {"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}, {"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}, {"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-unplugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}, {"server_uuid": "cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce", "name": "network-vif-plugged", "status": "completed", "tag": "47bfc8e1-6738-4590-8d62-5f81f6055b18"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] Creating event network-vif-deleted:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-5e11edbd-7414-49c7-89ed-839380fe67bd req-d1bc08ef-0930-4a18-bdd9-4300a7248713 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079007 May 01 22:33:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 50/144] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Creating event network-vif-unplugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] Creating event network-vif-plugged:47bfc8e1-6738-4590-8d62-5f81f6055b18 for instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce on user May 01 22:33:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-38fa27ed-83aa-410b-834c-4d70ebaab8ac req-d11f67c9-f316-4178-8876-e22363523b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033880 May 01 22:33:01 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:01 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:02 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:02 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:02 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:02 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-ffa4daed-7e31-4a8e-b62c-e7a1e16efbab tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 200 len: 1691 microversion: 2.87 time: 0.318567 May 01 22:33:02 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 48/146] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:33:01 2023] GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 1691 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:33:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] Creating event network-changed:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:33:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-71441717-90af-4305-9c27-73ccd4722be8 req-1f9e1277-f493-41c9-8b50-ab9322fe4b61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 May 01 22:33:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 51/147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:33:06 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "name": "network-vif-plugged", "status": "completed", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:06 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] Creating event network-vif-plugged:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:33:06 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-b98103a4-cb4e-4a73-999e-0e38b275b030 req-b51c2d01-7707-4e45-a081-732b2f79ac0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036117 May 01 22:33:06 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:07 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ac657f9b694e04872f9209eea31e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5feedabacbf648ad86bbe223d09710dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:07 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-b0bc1c7e-19e1-4a58-bd7c-3f39872171f7 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 200 len: 1569 microversion: 2.1 time: 0.235026 May 01 22:33:07 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:07 2023] GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "name": "network-vif-plugged", "status": "completed", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] Creating event network-vif-plugged:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:33:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-84e2735c-728a-4bd4-ae47-e5ca58ff4e93 req-64df09c7-c2d3-41b8-b494-93b6e8453778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030583 May 01 22:33:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 52/150] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:09 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:33:09 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d33d751f-f153-44b2-b1e1-16118dac1b62 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 204 len: 0 microversion: 2.1 time: 0.148785 May 01 22:33:09 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:33:09 2023] DELETE /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:09 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ac657f9b694e04872f9209eea31e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5feedabacbf648ad86bbe223d09710dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:09 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-b7acbb79-cbc1-43b7-b61d-1ff467c3451b tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 200 len: 1575 microversion: 2.1 time: 0.234156 May 01 22:33:09 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:09 2023] GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:10 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "name": "network-vif-unplugged", "status": "completed", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] Creating event network-vif-unplugged:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:33:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-0af3e0c7-07d1-44a8-9c74-44d8cef849e4 req-77aae2d7-f882-437b-b33f-e5aa61adb769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038119 May 01 22:33:10 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 53/153] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "name": "network-vif-deleted", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] Creating event network-vif-deleted:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:33:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-f7323da0-cde4-4ae6-b6b5-4a9823e7d3e0 req-92d7ceb8-3038-4b9d-8e27-eff2689abdcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028926 May 01 22:33:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:12 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b38d7c-1096-453f-8967-206fd1a27881", "name": "network-vif-plugged", "status": "completed", "tag": "112a16c2-a55b-4355-9a36-ebcd7551333e"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] Creating event network-vif-plugged:112a16c2-a55b-4355-9a36-ebcd7551333e for instance 45b38d7c-1096-453f-8967-206fd1a27881 on user May 01 22:33:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-4931326a-d5c6-488d-b6e0-682c7fec49ca req-07d80fa9-b13d-498d-ada3-2eb069be5912 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031110 May 01 22:33:12 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 51/155] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:20 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6f9551d7-a5ca-45fa-aee6-ba3bdd20ca9d tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0" status: 200 len: 1496 microversion: 2.1 time: 0.574717 May 01 22:33:20 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:19 2023] GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 => generated 1496 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:27 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] HTTP exception thrown: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Request method failure captured: May 01 22:33:27 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c HTTP/1.1 May 01 22:33:27 user devstack@n-api.service[61366]: Accept: application/json May 01 22:33:27 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:33:27 user devstack@n-api.service[61366]: Connection: close May 01 22:33:27 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:33:27 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:33:27 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:33:27 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:33:27 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:33:27 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD1yeaDT_CjMqRoEyt-f-q4qykocvdsqsNvisdohdkqamI9igUywtE8eL3mrnyygaK-mxn11uuSCdIy678c2irpPezu2prTxShPxZrCezTqfWA7YYrBUUYcgVoZG4uk8JMQHYBqgpGFwnp9kQndR9vC7RwVJQ7eKzHrho3GmufdkxII May 01 22:33:27 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:33:27 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:33:27 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:33:27 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:33:27 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:33:27 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:33:27 user devstack@n-api.service[61366]: X-Project-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:27 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:27 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:33:27 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:33:27 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:33:27 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:27 user devstack@n-api.service[61366]: X-Tenant-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:27 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:27 user devstack@n-api.service[61366]: X-User: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:27 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:33:27 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:33:27 user devstack@n-api.service[61366]: X-User-Id: 4318273f32ca4ef0a59e80f4a0c07a6e May 01 22:33:27 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:27 user devstack@n-api.service[61366]: method: > May 01 22:33:27 user devstack@n-api.service[61366]: exception: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:27 user devstack@n-api.service[61366]: action_args: {'id': '70ded3b8-a7b4-4ce7-9961-905cd4c45d7c'} May 01 22:33:27 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:27 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Returning 404 to user: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:33:27 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-792c07e6-f2d1-4ce6-aaa0-cda4446e3c67 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 404 len: 111 microversion: 2.1 time: 0.049701 May 01 22:33:27 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:27 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:33:27 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:27 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:27 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8e5bce25-d931-4474-b5ed-67c864018439 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '.version_select at 0x7fc7047b12d0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8e5bce25-d931-4474-b5ed-67c864018439 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562908744" status: 202 len: 0 microversion: 2.1 time: 0.043272 May 01 22:33:27 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1298 bytes} [Mon May 1 22:33:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562908744 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] HTTP exception thrown: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Request method failure captured: May 01 22:33:28 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c HTTP/1.1 May 01 22:33:28 user devstack@n-api.service[61365]: Accept: application/json May 01 22:33:28 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:33:28 user devstack@n-api.service[61365]: Connection: close May 01 22:33:28 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:33:28 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:33:28 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:33:28 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:33:28 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:33:28 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1yeaDT_CjMqRoEyt-f-q4qykocvdsqsNvisdohdkqamI9igUywtE8eL3mrnyygaK-mxn11uuSCdIy678c2irpPezu2prTxShPxZrCezTqfWA7YYrBUUYcgVoZG4uk8JMQHYBqgpGFwnp9kQndR9vC7RwVJQ7eKzHrho3GmufdkxII May 01 22:33:28 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:33:28 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:33:28 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:33:28 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:33:28 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:33:28 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:33:28 user devstack@n-api.service[61365]: X-Project-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:28 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:33:28 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:33:28 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:33:28 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61365]: X-Tenant-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:28 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61365]: X-User: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:28 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:33:28 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:33:28 user devstack@n-api.service[61365]: X-User-Id: 4318273f32ca4ef0a59e80f4a0c07a6e May 01 22:33:28 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:28 user devstack@n-api.service[61365]: method: > May 01 22:33:28 user devstack@n-api.service[61365]: exception: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61365]: action_args: {'id': '70ded3b8-a7b4-4ce7-9961-905cd4c45d7c'} May 01 22:33:28 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Returning 404 to user: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:33:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-93019ad5-060b-48f7-b7e5-f7eada08cb0b tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 404 len: 111 microversion: 2.1 time: 0.038246 May 01 22:33:28 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 55/159] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:33:28 2023] DELETE /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] [instance: 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] HTTP exception thrown: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Request method failure captured: May 01 22:33:28 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c HTTP/1.1 May 01 22:33:28 user devstack@n-api.service[61366]: Accept: application/json May 01 22:33:28 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:33:28 user devstack@n-api.service[61366]: Connection: close May 01 22:33:28 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:33:28 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:33:28 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:33:28 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:33:28 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:33:28 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD1yeaDT_CjMqRoEyt-f-q4qykocvdsqsNvisdohdkqamI9igUywtE8eL3mrnyygaK-mxn11uuSCdIy678c2irpPezu2prTxShPxZrCezTqfWA7YYrBUUYcgVoZG4uk8JMQHYBqgpGFwnp9kQndR9vC7RwVJQ7eKzHrho3GmufdkxII May 01 22:33:28 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:33:28 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:33:28 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:33:28 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:33:28 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:33:28 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:33:28 user devstack@n-api.service[61366]: X-Project-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:28 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:33:28 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:33:28 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acefa8bb65a94b25ada784bb805a5cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:33:28 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61366]: X-Tenant-Id: acefa8bb65a94b25ada784bb805a5cdf May 01 22:33:28 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-995924054 May 01 22:33:28 user devstack@n-api.service[61366]: X-User: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:28 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:33:28 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:33:28 user devstack@n-api.service[61366]: X-User-Id: 4318273f32ca4ef0a59e80f4a0c07a6e May 01 22:33:28 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-995924054-project-member May 01 22:33:28 user devstack@n-api.service[61366]: method: > May 01 22:33:28 user devstack@n-api.service[61366]: exception: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61366]: action_args: {'id': '70ded3b8-a7b4-4ce7-9961-905cd4c45d7c'} May 01 22:33:28 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. May 01 22:33:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:33:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] Returning 404 to user: Instance 70ded3b8-a7b4-4ce7-9961-905cd4c45d7c could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:33:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-25c506af-84c8-4b38-8fd9-21d653ca51f9 tempest-AttachSCSIVolumeTestJSON-995924054 tempest-AttachSCSIVolumeTestJSON-995924054-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c" status: 404 len: 111 microversion: 2.1 time: 0.027912 May 01 22:33:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:28 2023] GET /compute/v2.1/servers/70ded3b8-a7b4-4ce7-9961-905cd4c45d7c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:33:29 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-026ce741-9bd7-4572-bb7e-393405f40b0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Action: 'create', calling method: .version_select at 0x7fc704800940>, body: {"keypair": {"name": "tempest-keypair-805154829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPL5fcfDZ/Tacj5hewJQqNrKKB9vG4ENKDHGcaO+ptqpmUhcFuUL1qH738iENRg52YCo0DpQJsCtDJz8nMERMJDgeuvj/D5XEgpU25DBlTVveSnQHtLGoBB5lfFkfSvww=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:29 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-026ce741-9bd7-4572-bb7e-393405f40b0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Getting quotas for project 735d89fb5a174f6ba5b8be3efedae82b. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:33:29 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-026ce741-9bd7-4572-bb7e-393405f40b0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Getting quotas for user 7783d0250c8b4c54b2765b690a00180c and project 735d89fb5a174f6ba5b8be3efedae82b. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:33:29 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-026ce741-9bd7-4572-bb7e-393405f40b0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203015 May 01 22:33:29 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 53/161] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:33:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:33:30 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-971946729", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d48c2e7b-ed13-4c47-88b5-2cf1d62bce43"}], "security_groups": [{"name": "tempest-securitygroup--442093470"}], "key_name": "tempest-keypair-805154829", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] validate_networks() for [('d48c2e7b-ed13-4c47-88b5-2cf1d62bce43', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Getting quotas for project 735d89fb5a174f6ba5b8be3efedae82b. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Getting quotas for user 7783d0250c8b4c54b2765b690a00180c and project 735d89fb5a174f6ba5b8be3efedae82b. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:33:31 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:33:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-68d099c0-052f-40d1-8728-6b05969c4712 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718160 May 01 22:33:31 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 56/162] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:33:30 2023] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:33:31 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8a72489b-1a00-4cd8-9b8d-39c2736e150e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:31 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8a72489b-1a00-4cd8-9b8d-39c2736e150e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:31 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-8a72489b-1a00-4cd8-9b8d-39c2736e150e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:31 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8a72489b-1a00-4cd8-9b8d-39c2736e150e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1231 microversion: 2.1 time: 0.067195 May 01 22:33:31 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:31 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1231 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:34 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:34 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:34 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] Creating event network-changed:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:33:34 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-fdb7c8f8-92f7-4d6e-9cab-4a464e653b8c req-e076f89a-44bd-440d-aed9-0db9d39bfef4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 May 01 22:33:34 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "name": "network-vif-plugged", "status": "completed", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] Creating event network-vif-plugged:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:33:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-3740c41e-03d9-4c4a-a2e3-5af85799c07d req-6de12473-2660-46cf-85b0-c58d8add0928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 May 01 22:33:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 57/165] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "name": "network-vif-plugged", "status": "completed", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:38 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] Creating event network-vif-plugged:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:33:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-637e6475-ad19-4a6a-bf47-e84f612c1494 req-44707c55-0d5b-4672-bc1b-76c90726ae9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 May 01 22:33:38 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:49 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] HTTP exception thrown: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Request method failure captured: May 01 22:33:49 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce HTTP/1.1 May 01 22:33:49 user devstack@n-api.service[61364]: Accept: application/json May 01 22:33:49 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:33:49 user devstack@n-api.service[61364]: Connection: close May 01 22:33:49 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:33:49 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:33:49 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:33:49 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:33:49 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:33:49 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD2caAfIhhYOAzc6ZBfdNGc6JfFVGuGpJo3nDGcgBecQN-jKVlThUvGJNGw-o35w23QaoBYRN-ZMKbvEqRzdGF3AHhyDQrffhyKbZYt8SINrO3j8Ur9L3xvcZXl2n8Jy3YrsOxRyR3aqa3UDAqo85my2VO_Rj5NsC3RXhEqyWmDvuWY May 01 22:33:49 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:33:49 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:33:49 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:33:49 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:33:49 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:33:49 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:33:49 user devstack@n-api.service[61364]: X-Project-Id: b7cbab6c671b408a8807b15ba4319111 May 01 22:33:49 user devstack@n-api.service[61364]: X-Project-Name: tempest-TestMinimumBasicScenario-782738684 May 01 22:33:49 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:33:49 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:33:49 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:33:49 user devstack@n-api.service[61364]: X-Tenant: tempest-TestMinimumBasicScenario-782738684 May 01 22:33:49 user devstack@n-api.service[61364]: X-Tenant-Id: b7cbab6c671b408a8807b15ba4319111 May 01 22:33:49 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-TestMinimumBasicScenario-782738684 May 01 22:33:49 user devstack@n-api.service[61364]: X-User: tempest-TestMinimumBasicScenario-782738684-project-member May 01 22:33:49 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:33:49 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:33:49 user devstack@n-api.service[61364]: X-User-Id: 4eeaf3e2d4ae4d94847b9cb1266ae307 May 01 22:33:49 user devstack@n-api.service[61364]: X-User-Name: tempest-TestMinimumBasicScenario-782738684-project-member May 01 22:33:49 user devstack@n-api.service[61364]: method: > May 01 22:33:49 user devstack@n-api.service[61364]: exception: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. May 01 22:33:49 user devstack@n-api.service[61364]: action_args: {'id': 'cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce'} May 01 22:33:49 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. May 01 22:33:49 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:33:49 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Returning 404 to user: Instance cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:33:49 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e3c8cc2b-93ab-4c1e-8c46-302ae20cbc6b tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce" status: 404 len: 111 microversion: 2.1 time: 0.038868 May 01 22:33:49 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:49 2023] GET /compute/v2.1/servers/cc6c7ccb-1bbe-45b2-b842-0fec3587c8ce => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:33:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=5 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f5d85c43-cc9d-4a27-a512-b2807aa9e9fc tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '.version_select at 0x7fc7053eca60>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f5d85c43-cc9d-4a27-a512-b2807aa9e9fc tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1488907423" status: 202 len: 0 microversion: 2.1 time: 0.031120 May 01 22:33:49 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 58/168] 10.0.0.210 () {62 vars in 1349 bytes} [Mon May 1 22:33:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1488907423 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:52 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6cd10c56-08ff-4b1d-84c6-848f5881ae51 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 200 len: 1534 microversion: 2.1 time: 0.246767 May 01 22:33:52 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:51 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 1534 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:52 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-46d3e640-83f2-4388-a4cd-b2fbaceb364c tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Action: 'create', calling method: .version_select at 0x7fc7047b2b00>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1196616155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPkmoYAU3Yvl8JWadH1v5K8xh8E3mb/wpm+kOPUA0yJdD2He/w+Xs9w7zayGovYhH2lC3/+jTyqngrX4mUrfUR7lmIh9tYdqusSPhDW3mgD13p46ruQ4ej0xCVxqEu3PA=="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:52 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-46d3e640-83f2-4388-a4cd-b2fbaceb364c tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for project b7cbab6c671b408a8807b15ba4319111. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:33:52 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-46d3e640-83f2-4388-a4cd-b2fbaceb364c tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for user 4eeaf3e2d4ae4d94847b9cb1266ae307 and project b7cbab6c671b408a8807b15ba4319111. Resources: {'key_pairs'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:33:52 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-46d3e640-83f2-4388-a4cd-b2fbaceb364c tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045537 May 01 22:33:52 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:33:52 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:33:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-932034166", "imageRef": "4d47fe39-e5b4-4daa-a582-f726cb5058f6", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1196616155", "networks": [{"uuid": "1248f1c5-ebea-4d21-8867-928f631ce8cf"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:52 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] validate_networks() for [('1248f1c5-ebea-4d21-8867-928f631ce8cf', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for project b7cbab6c671b408a8807b15ba4319111. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Getting quotas for user 4eeaf3e2d4ae4d94847b9cb1266ae307 and project b7cbab6c671b408a8807b15ba4319111. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:33:53 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d47fe39-e5b4-4daa-a582-f726cb5058f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:33:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b8d98403-e9c0-4204-ad76-2aa6f6c39fa1 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.075932 May 01 22:33:53 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 59/171] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:33:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:33:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-96373543-204a-4537-a4ca-30f8a5f25162 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:33:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-96373543-204a-4537-a4ca-30f8a5f25162 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:33:53 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-96373543-204a-4537-a4ca-30f8a5f25162 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:33:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-96373543-204a-4537-a4ca-30f8a5f25162 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 200 len: 1252 microversion: 2.1 time: 0.065311 May 01 22:33:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:33:53 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 1252 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:33:57 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] Creating event network-changed:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:33:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-1ba2fd29-c993-4c3b-becc-e9934478b5bc req-7bf70b91-6bfd-4099-8923-4e8300900baf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027079 May 01 22:33:57 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:33:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "name": "network-vif-plugged", "status": "completed", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:33:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:33:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:33:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:33:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] Creating event network-vif-plugged:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:33:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-a5a8f918-368e-4a17-81db-cc03cd974fbf req-0eaa98a0-4729-434b-899a-4fe0a033d5fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037681 May 01 22:33:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 60/174] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] [instance: 45b38d7c-1096-453f-8967-206fd1a27881] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:00 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] HTTP exception thrown: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Request method failure captured: May 01 22:34:00 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 HTTP/1.1 May 01 22:34:00 user devstack@n-api.service[61366]: Accept: application/json May 01 22:34:00 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:34:00 user devstack@n-api.service[61366]: Connection: close May 01 22:34:00 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:34:00 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:34:00 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:34:00 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:34:00 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:34:00 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD2osnwlO4-bmIRGF4saU7jG5QLSN8VdxdMyhPWcbRXWKteLZWvUAfrxvXzJ4tznFFV383K4WqBzKz-bGFPGvYEtsh50xARh0UzXSJpiHYpBjSoO6a925q9Pbx8GElRhDAI4lQ3G3GoABG-IZ-H4fMf13RARVTwOrXz5Q9YFvt4ME2U May 01 22:34:00 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:34:00 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:34:00 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:34:00 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:34:00 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:34:00 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:34:00 user devstack@n-api.service[61366]: X-Project-Id: 5feedabacbf648ad86bbe223d09710dd May 01 22:34:00 user devstack@n-api.service[61366]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1222226911 May 01 22:34:00 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:34:00 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:34:00 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5feedabacbf648ad86bbe223d09710dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5feedabacbf648ad86bbe223d09710dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5feedabacbf648ad86bbe223d09710dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:34:00 user devstack@n-api.service[61366]: X-Tenant: tempest-SnapshotDataIntegrityTests-1222226911 May 01 22:34:00 user devstack@n-api.service[61366]: X-Tenant-Id: 5feedabacbf648ad86bbe223d09710dd May 01 22:34:00 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1222226911 May 01 22:34:00 user devstack@n-api.service[61366]: X-User: tempest-SnapshotDataIntegrityTests-1222226911-project-member May 01 22:34:00 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:34:00 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:34:00 user devstack@n-api.service[61366]: X-User-Id: f7ac657f9b694e04872f9209eea31e9d May 01 22:34:00 user devstack@n-api.service[61366]: X-User-Name: tempest-SnapshotDataIntegrityTests-1222226911-project-member May 01 22:34:00 user devstack@n-api.service[61366]: method: > May 01 22:34:00 user devstack@n-api.service[61366]: exception: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. May 01 22:34:00 user devstack@n-api.service[61366]: action_args: {'id': '45b38d7c-1096-453f-8967-206fd1a27881'} May 01 22:34:00 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. May 01 22:34:00 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:34:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Returning 404 to user: Instance 45b38d7c-1096-453f-8967-206fd1a27881 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:34:00 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-eb827410-ff63-4b97-b747-0688d914bd54 tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881" status: 404 len: 111 microversion: 2.1 time: 0.030126 May 01 22:34:00 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:00 2023] GET /compute/v2.1/servers/45b38d7c-1096-453f-8967-206fd1a27881 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 01 22:34:00 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-750c6f9a-37d8-46e8-8b9f-0cbbc0f16aea tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] Calling method '.version_select at 0x7fc7047b2cb0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:00 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-750c6f9a-37d8-46e8-8b9f-0cbbc0f16aea tempest-SnapshotDataIntegrityTests-1222226911 tempest-SnapshotDataIntegrityTests-1222226911-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-339213469" status: 202 len: 0 microversion: 2.1 time: 0.021991 May 01 22:34:00 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:34:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-339213469 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:34:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "name": "network-vif-plugged", "status": "completed", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] Creating event network-vif-plugged:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:34:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-6c635313-3279-4b80-afac-81ccc9d5638c req-0f42436c-7a8d-4c43-8f35-d33641fa880f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 May 01 22:34:02 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 61/177] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-875200372", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "7b537d45-40a4-4b68-9af9-58d63dce9c7b"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:02 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] validate_networks() for [('7b537d45-40a4-4b68-9af9-58d63dce9c7b', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for user d69bdbfb4f5844e1a5048ea211f81ac4 and project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:34:03 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:34:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0d955950-038b-470c-b714-ac755651ead9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.037664 May 01 22:34:03 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 59/178] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:34:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:03 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:03 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8e6fb53f-39c7-4054-bf34-201ae47cfd41 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c" status: 200 len: 1394 microversion: 2.87 time: 0.152362 May 01 22:34:03 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:34:03 2023] GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c => generated 1394 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:34:06 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:06 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-10467851", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "0d6614a5-a9d3-490a-8203-9852cedae39f"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:06 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] validate_networks() for [('0d6614a5-a9d3-490a-8203-9852cedae39f', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Getting quotas for project 751cec193a3945c785b177e032cfc758. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Getting quotas for user 925c76f9d5114b489c630b78ff0b763f and project 751cec193a3945c785b177e032cfc758. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:34:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:34:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-4d8b58f9-757a-4c87-a97e-ab3502d5e80b tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.480713 May 01 22:34:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 62/180] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:34:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:34:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e9c10708-4a60-4e73-8b63-ea05cc7f26a2 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:08 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e9c10708-4a60-4e73-8b63-ea05cc7f26a2 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:08 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e9c10708-4a60-4e73-8b63-ea05cc7f26a2 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:08 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed13a524-084b-44ea-aee5-ca484c4f5a6c", "tag": "9c7fd777-d1ad-4589-a3d2-e000c2bedf8a"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e9c10708-4a60-4e73-8b63-ea05cc7f26a2 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1209 microversion: 2.1 time: 0.111391 May 01 22:34:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 60/181] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:08 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:34:08 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:08 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:08 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:08 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:08 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] Creating event network-changed:9c7fd777-d1ad-4589-a3d2-e000c2bedf8a for instance ed13a524-084b-44ea-aee5-ca484c4f5a6c on user May 01 22:34:08 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-544fa27c-4703-4c8a-971f-6c8759134a0c req-cb046fe4-23a3-4a98-9f39-759565f0c9af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 May 01 22:34:08 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] Creating event network-changed:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:34:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-a736e16b-e0f8-42df-a465-749d939355ea req-11ff8676-323b-4072-8972-c4a97ad4ee94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034031 May 01 22:34:11 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 63/183] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed13a524-084b-44ea-aee5-ca484c4f5a6c", "name": "network-vif-deleted", "tag": "9c7fd777-d1ad-4589-a3d2-e000c2bedf8a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.compute.server_external_events [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] Unable to find a host for instance ed13a524-084b-44ea-aee5-ca484c4f5a6c. Dropping event network-vif-deleted {{(pid=61366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} May 01 22:34:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-918bf709-9fdd-4094-9144-e2ded1eb0d3b req-c8e51b9a-6413-49aa-9636-bef0dc4abcee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030643 May 01 22:34:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 61/184] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:11 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 01 22:34:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "name": "network-vif-plugged", "status": "completed", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] Creating event network-vif-plugged:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:34:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-89ac980b-5f44-4547-b89d-73c2a87b247b req-bda71528-571c-4f60-80e2-bb89eadd4895 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 May 01 22:34:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "name": "network-vif-plugged", "status": "completed", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] Creating event network-vif-plugged:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:34:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-b6a27094-44f3-474c-adee-593aebc39a1f req-61843baf-7dff-4457-bd6c-021fc179e695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 May 01 22:34:15 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 64/186] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=12 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0d56b433-e646-498b-a8ba-92fd2fea2595 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1538 microversion: 2.1 time: 0.257295 May 01 22:34:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 62/187] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:21 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1538 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:34:22 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-d92a6108-5887-415b-8b3a-2d2d7f9a335f tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0" status: 204 len: 0 microversion: 2.1 time: 0.118046 May 01 22:34:22 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 62/188] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:34:22 2023] DELETE /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=13 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "name": "network-vif-unplugged", "status": "completed", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] Creating event network-vif-unplugged:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:34:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-630ee481-ef28-4ceb-9084-f4141c47b7dc req-48a98c88-3f9d-4553-b675-7fe2dd5d345f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047548 May 01 22:34:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 63/189] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:22 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-010c514d-681f-4321-940d-2d54f84dae41 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0" status: 200 len: 1502 microversion: 2.1 time: 0.298048 May 01 22:34:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:22 2023] GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:34:23 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "name": "network-vif-deleted", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:23 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] Creating event network-vif-deleted:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:34:23 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-182f3fb3-d778-4b2f-bb32-30df75c66c76 req-65312c07-d635-4de4-a8fe-c1ae87690d8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033805 May 01 22:34:23 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:24 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e7402-f133-426f-9d91-4ae572bf72f0", "name": "network-vif-plugged", "status": "completed", "tag": "db9d49d8-3fdd-488d-9a11-537368ef267a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] Creating event network-vif-plugged:db9d49d8-3fdd-488d-9a11-537368ef267a for instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 on user May 01 22:34:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-20c7af8a-f4a0-4243-b2f3-2e4e085b046c req-628b0063-e91c-4931-9d9c-325d670b965d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029291 May 01 22:34:24 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 64/192] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=5 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:43 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e598e6d6-28c0-4a56-9858-81612dc89f59 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 200 len: 1534 microversion: 2.1 time: 0.237010 May 01 22:34:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:43 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 1534 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:52 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-768b7dec-ea00-4f67-9dc2-6fa463aa3e23 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.262977 May 01 22:34:52 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:34:52 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678/os-interface => generated 282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] Creating event network-changed:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:34:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-2250a644-c53c-423e-af4b-3560e26fdd18 req-29961240-1e01-4bb2-b99c-23b339438197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036639 May 01 22:34:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-375e5b58-47c0-4c25-9dcd-1014867bbede tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678/ips" status: 200 len: 103 microversion: 2.1 time: 0.040354 May 01 22:34:53 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:34:53 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678/ips => generated 103 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.objects.instance [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lazy-loading 'fault' on Instance uuid ed13a524-084b-44ea-aee5-ca484c4f5a6c {{(pid=61364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:53 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:53 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-cc77fba3-8e4d-4c89-a275-bf514039d2b9 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c" status: 200 len: 1649 microversion: 2.87 time: 0.134394 May 01 22:34:53 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 65/197] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:34:53 2023] GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c => generated 1649 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Doing local delete in cell 3894b638-48b8-4a73-93b9-2ff19b42c5cd(cell1) {{(pid=61366) _delete /opt/stack/nova/nova/compute/api.py:2546}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:53 user devstack@n-api.service[61366]: WARNING nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] instance's host None is down, deleting from database May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] deallocate_for_instance() {{(pid=61366) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Instance cache missing network info. {{(pid=61366) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Updating instance_info_cache with network_info: [] {{(pid=61366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} May 01 22:34:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61366) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} May 01 22:34:53 user devstack@n-api.service[61366]: WARNING nova.compute.api [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. May 01 22:34:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-973d2851-236a-481e-a382-9e0e0ffa8d44 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c" status: 204 len: 0 microversion: 2.87 time: 0.559395 May 01 22:34:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:34:53 2023] DELETE /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: ed13a524-084b-44ea-aee5-ca484c4f5a6c] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] HTTP exception thrown: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Request method failure captured: May 01 22:34:54 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c HTTP/1.1 May 01 22:34:54 user devstack@n-api.service[61365]: Accept: application/json May 01 22:34:54 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:34:54 user devstack@n-api.service[61365]: Connection: close May 01 22:34:54 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:34:54 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:34:54 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:34:54 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:34:54 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:34:54 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD2onzlrG3KUcmS2ZNLOvgKGVcJup3_Lprj2R4GN9Trv_v7t74XcbMcfLEWHQtHCCetxPJtqm7lk28skhDV9nhRx7-XRSlukIsC1Y8yJGaMIebGD8R1KlrHXDlX1HWgDuI-_elht89ote7yz4JK62vgwn6fmKRd4oKhDeD_LAjK_2QY May 01 22:34:54 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:34:54 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:34:54 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:34:54 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:34:54 user devstack@n-api.service[61365]: X-Openstack-Nova-Api-Version: 2.87 May 01 22:34:54 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:34:54 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:34:54 user devstack@n-api.service[61365]: X-Project-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:34:54 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:34:54 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:34:54 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:34:54 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:34:54 user devstack@n-api.service[61365]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:34:54 user devstack@n-api.service[61365]: X-Tenant-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:34:54 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:34:54 user devstack@n-api.service[61365]: X-User: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:34:54 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:34:54 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:34:54 user devstack@n-api.service[61365]: X-User-Id: d69bdbfb4f5844e1a5048ea211f81ac4 May 01 22:34:54 user devstack@n-api.service[61365]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:34:54 user devstack@n-api.service[61365]: method: > May 01 22:34:54 user devstack@n-api.service[61365]: exception: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. May 01 22:34:54 user devstack@n-api.service[61365]: action_args: {'id': 'ed13a524-084b-44ea-aee5-ca484c4f5a6c'} May 01 22:34:54 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. May 01 22:34:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Returning 404 to user: Instance ed13a524-084b-44ea-aee5-ca484c4f5a6c could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:34:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-aa72354a-c5dc-468d-b78f-8d9886ebf220 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c" status: 404 len: 111 microversion: 2.87 time: 0.032301 May 01 22:34:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 68/199] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:34:54 2023] GET /compute/v2.1/servers/ed13a524-084b-44ea-aee5-ca484c4f5a6c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-909361970", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "7b537d45-40a4-4b68-9af9-58d63dce9c7b"}]}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] validate_networks() for [('7b537d45-40a4-4b68-9af9-58d63dce9c7b', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:34:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-fe254fbd-cd73-47bf-8998-f6b7f5a08626 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 204 len: 0 microversion: 2.1 time: 0.110423 May 01 22:34:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:34:54 2023] DELETE /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for user d69bdbfb4f5844e1a5048ea211f81ac4 and project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:34:55 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-b4f96b48-27d2-4a34-8ac2-5bf3ab47f6be tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.611338 May 01 22:34:55 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 66/201] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:34:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:34:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:55 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:55 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "name": "network-vif-unplugged", "status": "completed", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:55 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:55 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-dd9f6376-f0db-4053-b192-b957b63dafb7 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 200 len: 1394 microversion: 2.87 time: 0.082386 May 01 22:34:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 68/202] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:34:55 2023] GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 1394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:55 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:55 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] Creating event network-vif-unplugged:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:34:55 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-6e7456b8-112b-4768-87f9-d67469e6efa9 req-e637f1d9-edd0-4e6f-9c73-458d0c697089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034575 May 01 22:34:55 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 67/203] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:55 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0571539c56f1431883cdae05ae7f99e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f36d96876e417789670fcba7eaae47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-96fa85d4-f46c-4997-adf3-2aca999d74c7 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 200 len: 1658 microversion: 2.1 time: 0.357971 May 01 22:34:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:54 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 1658 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:34:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "name": "network-vif-deleted", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] Creating event network-vif-deleted:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:34:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-67e1c6d5-f1d2-489a-822e-4c19fd78c6c1 req-1733ffc2-b8d9-4b19-90ba-a014878d0c49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028026 May 01 22:34:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:57 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cda8b1-f89c-416b-8026-dbd63a0fe678", "name": "network-vif-plugged", "status": "completed", "tag": "468b1264-fa0c-4ff2-bb55-2371e94d792c"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:57 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] Creating event network-vif-plugged:468b1264-fa0c-4ff2-bb55-2371e94d792c for instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 on user May 01 22:34:57 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-73b7b00c-d5bc-45c0-8ae5-5710a0e83eae req-843b38b8-b851-4ac5-83be-92967509098e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028075 May 01 22:34:57 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:58 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:34:58 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-623d342c-2126-47e6-9e07-b6d0cf256639 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1493 microversion: 2.1 time: 0.528344 May 01 22:34:58 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:34:58 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1493 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:34:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:34:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:34:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:34:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:34:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] Creating event network-changed:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:34:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-651f57c9-acf7-48aa-8d67-41ba25a0c8b0 req-5106ef92-5356-44c7-847e-7ee24ac14ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028102 May 01 22:34:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:01 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "name": "network-vif-plugged", "status": "completed", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}, {"server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "name": "network-vif-plugged", "status": "completed", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Creating event network-vif-plugged:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:35:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] Creating event network-vif-plugged:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:35:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-51e6e644-bedf-4e19-b27b-ac39139e9293 req-fc3e8658-5abb-45f8-9937-3373e2844763 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029150 May 01 22:35:01 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 6f7e7402-f133-426f-9d91-4ae572bf72f0] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=10 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=24 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] HTTP exception thrown: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Request method failure captured: May 01 22:35:12 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 HTTP/1.1 May 01 22:35:12 user devstack@n-api.service[61365]: Accept: application/json May 01 22:35:12 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:35:12 user devstack@n-api.service[61365]: Connection: close May 01 22:35:12 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:35:12 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:35:12 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:35:12 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:35:12 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:35:12 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1shJtYuKGl1XUWdhnZx0ReCf3BGakIcoCswPLO0imW4qzSOl1IKVJT9eZlki-VDZrAI1pizIPNcYJLA3F3abrR1qeb342ofh5vOXQ0dE2vjmad8LJ6L1Hlr9jjyUQ6ASAj7Wbt2AIs-ou08SForqTG1AVOq5Wbe_r7HH2EgAbhg8o May 01 22:35:12 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:35:12 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:35:12 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:35:12 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:35:12 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:35:12 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:35:12 user devstack@n-api.service[61365]: X-Project-Id: 75ef8c62d77b49e18c37c546261d4f27 May 01 22:35:12 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesAdminNegativeTest-603524561 May 01 22:35:12 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:35:12 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:35:12 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:12 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesAdminNegativeTest-603524561 May 01 22:35:12 user devstack@n-api.service[61365]: X-Tenant-Id: 75ef8c62d77b49e18c37c546261d4f27 May 01 22:35:12 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-603524561 May 01 22:35:12 user devstack@n-api.service[61365]: X-User: tempest-VolumesAdminNegativeTest-603524561-project-member May 01 22:35:12 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:35:12 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:35:12 user devstack@n-api.service[61365]: X-User-Id: fbcde31ec47741d1ac197046bc3aa999 May 01 22:35:12 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesAdminNegativeTest-603524561-project-member May 01 22:35:12 user devstack@n-api.service[61365]: method: > May 01 22:35:12 user devstack@n-api.service[61365]: exception: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. May 01 22:35:12 user devstack@n-api.service[61365]: action_args: {'id': '6f7e7402-f133-426f-9d91-4ae572bf72f0'} May 01 22:35:12 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. May 01 22:35:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Returning 404 to user: Instance 6f7e7402-f133-426f-9d91-4ae572bf72f0 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6bc52ab5-106e-43e5-979d-6b57fa84cd26 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0" status: 404 len: 111 microversion: 2.1 time: 0.030381 May 01 22:35:12 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:12 2023] GET /compute/v2.1/servers/6f7e7402-f133-426f-9d91-4ae572bf72f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:12 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:35:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-31744592-7cf3-44e1-a3a6-d9ad84dc6ec9 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767" status: 204 len: 0 microversion: 2.1 time: 0.122517 May 01 22:35:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:35:12 2023] DELETE /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=20 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "name": "network-vif-unplugged", "status": "completed", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] Creating event network-vif-unplugged:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:35:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-722f4cf7-bf7f-45d5-83e1-e139311c4de3 req-b2e90b86-6040-407e-8f49-59402275a812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036418 May 01 22:35:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:13 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcde31ec47741d1ac197046bc3aa999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ef8c62d77b49e18c37c546261d4f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-68ab73a9-dfab-4046-915f-527d3f470b38 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767" status: 200 len: 1669 microversion: 2.1 time: 0.430239 May 01 22:35:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 70/213] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:12 2023] GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:35:14 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "name": "network-vif-deleted", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:14 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:14 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:14 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:14 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] Creating event network-vif-deleted:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:35:14 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a102a96e-b094-45e0-8eb2-c13d90e9f289 req-53097872-9956-496f-a1f4-2476bd9e8bf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029988 May 01 22:35:14 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c66805d-fd1d-4546-80a6-290215fd8767", "name": "network-vif-plugged", "status": "completed", "tag": "a903e574-5cd1-460e-9d7e-e90a63f8d06d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] Creating event network-vif-plugged:a903e574-5cd1-460e-9d7e-e90a63f8d06d for instance 0c66805d-fd1d-4546-80a6-290215fd8767 on user May 01 22:35:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-5c7b852b-900b-4994-b6fb-ca4131137660 req-3c5a8862-9d36-4d2b-8e08-e4023d01e17b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 May 01 22:35:15 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:22 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8f828038-ac69-43ec-9863-f8b9a586241a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.196985 May 01 22:35:22 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 71/216] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:35:22 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384/os-interface => generated 283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:23 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] Creating event network-changed:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:35:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-9412e5fe-6e7f-4d11-af2c-cc65ec4efd6c req-8661e3ec-0200-4cad-a2fd-ca046fb77274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086806 May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:23 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 73/217] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:23 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b22f060c-4819-4e60-8b8d-f7fca09c0b1e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1538 microversion: 2.1 time: 0.371178 May 01 22:35:23 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:23 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1538 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:23 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:23 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-cfed78bf-21a8-46f6-b5a3-47e1f533eb0c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1538 microversion: 2.1 time: 0.147759 May 01 22:35:23 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 72/219] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:23 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1538 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:44 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-4cb97c04-6b45-4c05-8d7c-78515c4de411 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 200 len: 1534 microversion: 2.1 time: 0.328274 May 01 22:35:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:43 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 1534 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Searching by: {'deleted': False, 'project_id': 'b7cbab6c671b408a8807b15ba4319111'} {{(pid=61365) get_all /opt/stack/nova/nova/compute/api.py:3019}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=12 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:44 user devstack@n-api.service[61365]: DEBUG nova.compute.multi_cell_list [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 01 22:35:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-18cbdfdc-7533-425a-b651-706b097414d9 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.071452 May 01 22:35:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 75/221] 10.0.0.210 () {62 vars in 1202 bytes} [Mon May 1 22:35:44 2023] GET /compute/v2.1/servers => generated 340 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=16 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:44 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-a3b04462-1205-49af-ab8a-d8c8b184ddda tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 200 len: 1534 microversion: 2.1 time: 0.235172 May 01 22:35:44 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 73/222] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:44 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 1534 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:45 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:35:45 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 HTTP/1.1 May 01 22:35:45 user devstack@n-api.service[61365]: Accept: application/json May 01 22:35:45 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:35:45 user devstack@n-api.service[61365]: Connection: close May 01 22:35:45 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:35:45 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:35:45 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:35:45 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:35:45 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:35:45 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:35:45 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:35:45 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:35:45 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:35:45 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:35:45 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:35:45 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:35:45 user devstack@n-api.service[61365]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:45 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:45 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:35:45 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:35:45 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:45 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:45 user devstack@n-api.service[61365]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:45 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:45 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:45 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:35:45 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:35:45 user devstack@n-api.service[61365]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:35:45 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:45 user devstack@n-api.service[61365]: method: > May 01 22:35:45 user devstack@n-api.service[61365]: exception: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:45 user devstack@n-api.service[61365]: action_args: {'id': '31cda8b1-f89c-416b-8026-dbd63a0fe678'} May 01 22:35:45 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:45 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3809dab4-88e2-427a-88ba-8b1b2fce0296 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 404 len: 111 microversion: 2.1 time: 0.130975 May 01 22:35:45 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:45 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:45 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-92c1e2d0-7770-4cd8-9053-51023258a91f tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '.version_select at 0x7fc7047b3640>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:45 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-92c1e2d0-7770-4cd8-9053-51023258a91f tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403460319" status: 202 len: 0 microversion: 2.1 time: 0.025918 May 01 22:35:45 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1295 bytes} [Mon May 1 22:35:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403460319 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:45 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-392bf881-11b9-48ea-b85b-7f732c2d385b tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 200 len: 1691 microversion: 2.87 time: 0.286298 May 01 22:35:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 75/225] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:35:45 2023] GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 1691 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:35:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-7e21ed20-c255-4ed3-8564-996d1855d53e tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 204 len: 0 microversion: 2.1 time: 0.136068 May 01 22:35:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:35:46 2023] DELETE /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:35:46 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 HTTP/1.1 May 01 22:35:46 user devstack@n-api.service[61366]: Accept: application/json May 01 22:35:46 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:35:46 user devstack@n-api.service[61366]: Connection: close May 01 22:35:46 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:35:46 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:35:46 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:35:46 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:35:46 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:35:46 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:35:46 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:35:46 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:35:46 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:35:46 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:35:46 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61366]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:35:46 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:35:46 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:46 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61366]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61366]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:35:46 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61366]: method: > May 01 22:35:46 user devstack@n-api.service[61366]: exception: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61366]: action_args: {'id': '31cda8b1-f89c-416b-8026-dbd63a0fe678'} May 01 22:35:46 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ee2a263f-c13b-4e8f-9531-671e3d81014e tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 404 len: 111 microversion: 2.1 time: 0.027914 May 01 22:35:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:35:46 2023] DELETE /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 31cda8b1-f89c-416b-8026-dbd63a0fe678] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:35:46 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 HTTP/1.1 May 01 22:35:46 user devstack@n-api.service[61365]: Accept: application/json May 01 22:35:46 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:35:46 user devstack@n-api.service[61365]: Connection: close May 01 22:35:46 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:35:46 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:35:46 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:35:46 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:35:46 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:35:46 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:35:46 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:35:46 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:35:46 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:35:46 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:35:46 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:35:46 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61365]: method: > May 01 22:35:46 user devstack@n-api.service[61365]: exception: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: action_args: {'id': '31cda8b1-f89c-416b-8026-dbd63a0fe678'} May 01 22:35:46 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 31cda8b1-f89c-416b-8026-dbd63a0fe678 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-547ee6c4-5649-4627-b073-6ed71ea5d0cf tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678" status: 404 len: 111 microversion: 2.1 time: 0.042904 May 01 22:35:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 78/228] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:46 2023] GET /compute/v2.1/servers/31cda8b1-f89c-416b-8026-dbd63a0fe678 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeaf3e2d4ae4d94847b9cb1266ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cbab6c671b408a8807b15ba4319111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-c7f8bc25-bb56-4d3d-ba9e-8757d8de24a2 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 200 len: 1540 microversion: 2.1 time: 0.190886 May 01 22:35:46 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:46 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 1540 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "name": "network-vif-unplugged", "status": "completed", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] Creating event network-vif-unplugged:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:35:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-ce9f43b8-8081-41fa-936f-2550ef0e25ee req-57a0d1a7-bef2-4096-991a-68d8b460daa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041713 May 01 22:35:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:35:46 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 HTTP/1.1 May 01 22:35:46 user devstack@n-api.service[61365]: Accept: application/json May 01 22:35:46 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:35:46 user devstack@n-api.service[61365]: Connection: close May 01 22:35:46 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:35:46 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:35:46 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:35:46 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:35:46 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:35:46 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:35:46 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:35:46 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:35:46 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:35:46 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:35:46 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:35:46 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:35:46 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61365]: method: > May 01 22:35:46 user devstack@n-api.service[61365]: exception: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: action_args: {'id': '8c22a392-d145-4477-81d1-b5d3f3c599f3'} May 01 22:35:46 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dc25029f-9743-408b-9009-c7b8203b31bd tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 404 len: 111 microversion: 2.1 time: 0.029167 May 01 22:35:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:35:46 2023] DELETE /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] [instance: 8c22a392-d145-4477-81d1-b5d3f3c599f3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] HTTP exception thrown: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Request method failure captured: May 01 22:35:46 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 HTTP/1.1 May 01 22:35:46 user devstack@n-api.service[61364]: Accept: application/json May 01 22:35:46 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:35:46 user devstack@n-api.service[61364]: Connection: close May 01 22:35:46 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:35:46 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:35:46 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:35:46 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:35:46 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:35:46 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD1vqVZLtwUuKVT6j56101_aqTOBpj-LBypoUo7qSWekNAZyxFdXehCQqPk5i99_BD4HtQLQQ1xsG23nCFHU1rlNbnFgWDuSkLh87Lym6I-pauJUuoW19GVqBXz4pJkQC2bUP0c_qcG7eQSN1EAqOHvPL8HJrthgpaJMXNRnHUhY5dQ May 01 22:35:46 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:35:46 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:35:46 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:35:46 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:35:46 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61364]: X-Project-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:35:46 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:35:46 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52f36d96876e417789670fcba7eaae47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52f36d96876e417789670fcba7eaae47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:35:46 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61364]: X-Tenant-Id: 52f36d96876e417789670fcba7eaae47 May 01 22:35:46 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeTestJSON-571049895 May 01 22:35:46 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:35:46 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:35:46 user devstack@n-api.service[61364]: X-User-Id: 0571539c56f1431883cdae05ae7f99e9 May 01 22:35:46 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeTestJSON-571049895-project-member May 01 22:35:46 user devstack@n-api.service[61364]: method: > May 01 22:35:46 user devstack@n-api.service[61364]: exception: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61364]: action_args: {'id': '8c22a392-d145-4477-81d1-b5d3f3c599f3'} May 01 22:35:46 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. May 01 22:35:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:35:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] Returning 404 to user: Instance 8c22a392-d145-4477-81d1-b5d3f3c599f3 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:35:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-f53f86da-caae-4fb9-ab77-81bd10363fb6 tempest-AttachVolumeTestJSON-571049895 tempest-AttachVolumeTestJSON-571049895-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3" status: 404 len: 111 microversion: 2.1 time: 0.033124 May 01 22:35:46 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 76/232] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:46 2023] GET /compute/v2.1/servers/8c22a392-d145-4477-81d1-b5d3f3c599f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:35:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "name": "network-vif-plugged", "status": "completed", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}, {"server_uuid": "d589739d-dc73-4fbf-bf2f-b6bf162fceae", "name": "network-vif-deleted", "tag": "a34c719b-3814-45f5-8bb3-409663c8ed33"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Creating event network-vif-plugged:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:35:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] Creating event network-vif-deleted:a34c719b-3814-45f5-8bb3-409663c8ed33 for instance d589739d-dc73-4fbf-bf2f-b6bf162fceae on user May 01 22:35:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-db90390a-8d11-4f6d-bd56-782adf619c1c req-3c4e701e-400a-494b-90ba-5a06215767ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034600 May 01 22:35:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1342561462", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "0d6614a5-a9d3-490a-8203-9852cedae39f"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] validate_networks() for [('0d6614a5-a9d3-490a-8203-9852cedae39f', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Getting quotas for project 751cec193a3945c785b177e032cfc758. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Getting quotas for user 925c76f9d5114b489c630b78ff0b763f and project 751cec193a3945c785b177e032cfc758. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:35:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:35:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-80d2c452-e2a1-496e-ba5a-a1e1e45781a5 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.569524 May 01 22:35:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 80/234] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:35:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:35:59 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:59 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=14 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:35:59 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-92094f4c-5aa0-4f2c-b767-bacc28868fcd tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:35:59 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-92094f4c-5aa0-4f2c-b767-bacc28868fcd tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:35:59 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-92094f4c-5aa0-4f2c-b767-bacc28868fcd tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:35:59 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-92094f4c-5aa0-4f2c-b767-bacc28868fcd tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 200 len: 1211 microversion: 2.1 time: 0.077289 May 01 22:35:59 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 77/235] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:35:59 2023] GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=12 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=18 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] Creating event network-changed:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:36:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c0095ae3-06ab-47c1-a861-f44c25642687 req-4821c35c-a023-461f-8e7e-4bc19332a4cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032443 May 01 22:36:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] [instance: 0c66805d-fd1d-4546-80a6-290215fd8767] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] HTTP exception thrown: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Request method failure captured: May 01 22:36:03 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 HTTP/1.1 May 01 22:36:03 user devstack@n-api.service[61365]: Accept: application/json May 01 22:36:03 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:36:03 user devstack@n-api.service[61365]: Connection: close May 01 22:36:03 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:36:03 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:36:03 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:36:03 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:36:03 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:36:03 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD1shJtYuKGl1XUWdhnZx0ReCf3BGakIcoCswPLO0imW4qzSOl1IKVJT9eZlki-VDZrAI1pizIPNcYJLA3F3abrR1qeb342ofh5vOXQ0dE2vjmad8LJ6L1Hlr9jjyUQ6ASAj7Wbt2AIs-ou08SForqTG1AVOq5Wbe_r7HH2EgAbhg8o May 01 22:36:03 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:36:03 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:36:03 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:36:03 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:36:03 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:36:03 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:36:03 user devstack@n-api.service[61365]: X-Project-Id: 75ef8c62d77b49e18c37c546261d4f27 May 01 22:36:03 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesAdminNegativeTest-603524561 May 01 22:36:03 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:36:03 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:36:03 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75ef8c62d77b49e18c37c546261d4f27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:36:03 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesAdminNegativeTest-603524561 May 01 22:36:03 user devstack@n-api.service[61365]: X-Tenant-Id: 75ef8c62d77b49e18c37c546261d4f27 May 01 22:36:03 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-603524561 May 01 22:36:03 user devstack@n-api.service[61365]: X-User: tempest-VolumesAdminNegativeTest-603524561-project-member May 01 22:36:03 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:36:03 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:36:03 user devstack@n-api.service[61365]: X-User-Id: fbcde31ec47741d1ac197046bc3aa999 May 01 22:36:03 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesAdminNegativeTest-603524561-project-member May 01 22:36:03 user devstack@n-api.service[61365]: method: > May 01 22:36:03 user devstack@n-api.service[61365]: exception: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. May 01 22:36:03 user devstack@n-api.service[61365]: action_args: {'id': '0c66805d-fd1d-4546-80a6-290215fd8767'} May 01 22:36:03 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. May 01 22:36:03 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Returning 404 to user: Instance 0c66805d-fd1d-4546-80a6-290215fd8767 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:36:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3da8165d-f7f0-44da-95f4-069bdd6b3265 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767" status: 404 len: 111 microversion: 2.1 time: 0.208556 May 01 22:36:03 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 81/237] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:03 2023] GET /compute/v2.1/servers/0c66805d-fd1d-4546-80a6-290215fd8767 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:36:03 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-404f5d7c-b1b7-4998-b402-954a25b7e441 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] Calling method '.version_select at 0x7fc704639cf0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:03 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-404f5d7c-b1b7-4998-b402-954a25b7e441 tempest-VolumesAdminNegativeTest-603524561 tempest-VolumesAdminNegativeTest-603524561-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327918259" status: 202 len: 0 microversion: 2.1 time: 0.023619 May 01 22:36:03 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 78/238] 10.0.0.210 () {62 vars in 1295 bytes} [Mon May 1 22:36:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327918259 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:36:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "name": "network-vif-plugged", "status": "completed", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] Creating event network-vif-plugged:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:36:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-941750f1-bfab-4037-bd41-753cdcd65ff2 req-c58f4a49-e115-401b-ad03-64e25c1b848c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 May 01 22:36:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "name": "network-vif-plugged", "status": "completed", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] Creating event network-vif-plugged:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:36:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-64dc65a2-a884-4e8b-a4ae-67e0fd4b978b req-770e26ed-e990-4f74-bf53-9ef296f97c3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028372 May 01 22:36:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:13 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-9355ed42-c624-4175-8d08-bfdb5499139d tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.255792 May 01 22:36:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 79/241] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:13 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:14 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:14 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d7ea17a2-6710-48da-8f3f-d5487fa6ba49 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.223942 May 01 22:36:14 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:13 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f6410c0d-f84e-4b5c-9c21-b2ddec1d80d4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Action: 'create', calling method: .version_select at 0x7fc7047c71c0>, body: {"keypair": {"name": "tempest-keypair-1352999903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzadErcEw6Xeca5/g0jI+V7AD9RYRodKDaHxH0rniW3hBCbdKELSUZw0ho13KiNey6wb1gu7ealyTlRqoZgXpBdXJy5XJU9Oih1bMCgmzZJ2UVx/Xcra5QE8ZAnPguQkg=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-f6410c0d-f84e-4b5c-9c21-b2ddec1d80d4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Getting quotas for project 2860c5ee6a3d4273937790ee0537d4ab. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:36:19 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-f6410c0d-f84e-4b5c-9c21-b2ddec1d80d4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Getting quotas for user 118102d5bfbf420cbcb460d4ec476c00 and project 2860c5ee6a3d4273937790ee0537d4ab. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:36:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f6410c0d-f84e-4b5c-9c21-b2ddec1d80d4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156384 May 01 22:36:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 83/243] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:36:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:20 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1127539257", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "b5a37492-ec37-4485-a1bb-ff560bcd47b6"}], "security_groups": [{"name": "tempest-securitygroup--1222792214"}], "key_name": "tempest-keypair-1352999903", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:20 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] validate_networks() for [('b5a37492-ec37-4485-a1bb-ff560bcd47b6', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Getting quotas for project 2860c5ee6a3d4273937790ee0537d4ab. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Getting quotas for user 118102d5bfbf420cbcb460d4ec476c00 and project 2860c5ee6a3d4273937790ee0537d4ab. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:36:21 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:36:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-3c5cabdb-5e56-4e46-9e76-34ee4f5297f4 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.700207 May 01 22:36:21 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 80/244] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:36:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:36:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0bf7f95e-3e6c-460a-91e4-f530b7ffba94 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0bf7f95e-3e6c-460a-91e4-f530b7ffba94 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:21 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0bf7f95e-3e6c-460a-91e4-f530b7ffba94 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118102d5bfbf420cbcb460d4ec476c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2860c5ee6a3d4273937790ee0537d4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0bf7f95e-3e6c-460a-91e4-f530b7ffba94 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 200 len: 1240 microversion: 2.1 time: 0.073174 May 01 22:36:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:21 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:36:24 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:24 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:24 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:24 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:24 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] Creating event network-changed:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:36:24 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-0a16e3d1-6fe2-4863-b475-bd046aa38c96 req-db4fa78f-e725-4124-b201-ffecb76a68e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029098 May 01 22:36:24 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 84/246] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:26 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "name": "network-vif-plugged", "status": "completed", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:26 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:26 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:26 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:26 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] Creating event network-vif-plugged:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:36:26 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-c4e30fa8-dbeb-453c-94fc-1b0fc8bd8c63 req-3243cf7f-c45b-4ab6-ab3b-e59332688e6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086392 May 01 22:36:26 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 81/247] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "name": "network-vif-plugged", "status": "completed", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:28 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] Creating event network-vif-plugged:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:36:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c1444017-6b28-4cff-8247-963ca2ed5505 req-ebfabfc7-20ae-4656-9303-1c0518b42fee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046445 May 01 22:36:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] [instance: d589739d-dc73-4fbf-bf2f-b6bf162fceae] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] HTTP exception thrown: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Request method failure captured: May 01 22:36:36 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae HTTP/1.1 May 01 22:36:36 user devstack@n-api.service[61365]: Accept: application/json May 01 22:36:36 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:36:36 user devstack@n-api.service[61365]: Connection: close May 01 22:36:36 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:36:36 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:36:36 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:36:36 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:36:36 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:36:36 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD2caAfIhhYOAzc6ZBfdNGc6JfFVGuGpJo3nDGcgBecQN-jKVlThUvGJNGw-o35w23QaoBYRN-ZMKbvEqRzdGF3AHhyDQrffhyKbZYt8SINrO3j8Ur9L3xvcZXl2n8Jy3YrsOxRyR3aqa3UDAqo85my2VO_Rj5NsC3RXhEqyWmDvuWY May 01 22:36:36 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:36:36 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:36:36 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:36:36 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:36:36 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:36:36 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:36:36 user devstack@n-api.service[61365]: X-Project-Id: b7cbab6c671b408a8807b15ba4319111 May 01 22:36:36 user devstack@n-api.service[61365]: X-Project-Name: tempest-TestMinimumBasicScenario-782738684 May 01 22:36:36 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:36:36 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:36:36 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7cbab6c671b408a8807b15ba4319111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:36:36 user devstack@n-api.service[61365]: X-Tenant: tempest-TestMinimumBasicScenario-782738684 May 01 22:36:36 user devstack@n-api.service[61365]: X-Tenant-Id: b7cbab6c671b408a8807b15ba4319111 May 01 22:36:36 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-TestMinimumBasicScenario-782738684 May 01 22:36:36 user devstack@n-api.service[61365]: X-User: tempest-TestMinimumBasicScenario-782738684-project-member May 01 22:36:36 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:36:36 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:36:36 user devstack@n-api.service[61365]: X-User-Id: 4eeaf3e2d4ae4d94847b9cb1266ae307 May 01 22:36:36 user devstack@n-api.service[61365]: X-User-Name: tempest-TestMinimumBasicScenario-782738684-project-member May 01 22:36:36 user devstack@n-api.service[61365]: method: > May 01 22:36:36 user devstack@n-api.service[61365]: exception: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. May 01 22:36:36 user devstack@n-api.service[61365]: action_args: {'id': 'd589739d-dc73-4fbf-bf2f-b6bf162fceae'} May 01 22:36:36 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. May 01 22:36:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:36:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Returning 404 to user: Instance d589739d-dc73-4fbf-bf2f-b6bf162fceae could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:36:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-84993b27-1b92-48de-b482-eb96d1ca0fcf tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae" status: 404 len: 111 microversion: 2.1 time: 0.140402 May 01 22:36:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 85/249] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:36 2023] GET /compute/v2.1/servers/d589739d-dc73-4fbf-bf2f-b6bf162fceae => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:36:36 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=10 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:36 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-0aeb212a-1419-4a0e-b9dc-e4a792eb85e8 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] Calling method '.version_select at 0x7fc7047b0ca0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:36 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-0aeb212a-1419-4a0e-b9dc-e4a792eb85e8 tempest-TestMinimumBasicScenario-782738684 tempest-TestMinimumBasicScenario-782738684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1196616155" status: 202 len: 0 microversion: 2.1 time: 0.032758 May 01 22:36:36 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1349 bytes} [Mon May 1 22:36:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1196616155 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=12 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-995414479"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5f85ef6a-ec81-4a8e-a1bf-c9b96dcf2242 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78/action" status: 202 len: 52 microversion: 2.87 time: 1.027404 May 01 22:36:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 84/251] 10.0.0.210 () {66 vars in 1396 bytes} [Mon May 1 22:36:45 2023] POST /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78/action => generated 52 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:50 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f5937f92-c7e5-4b5c-a369-12920cadb915 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 200 len: 1495 microversion: 2.1 time: 0.254422 May 01 22:36:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 86/252] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:36:49 2023] GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 1495 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:36:51 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:36:52 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:52 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:52 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:36:52 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-7abf98d8-071e-4027-994e-eaface38dba8 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 200 len: 1691 microversion: 2.87 time: 0.251884 May 01 22:36:52 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 83/253] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:36:51 2023] GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:11 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118102d5bfbf420cbcb460d4ec476c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2860c5ee6a3d4273937790ee0537d4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e04144db-3710-48a2-80a6-5b2c70169a7d tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 200 len: 1555 microversion: 2.1 time: 0.267972 May 01 22:37:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 85/254] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:37:11 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:15 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-cfd71f1a-db58-4ef5-9b87-ddb6564acc50 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.232479 May 01 22:37:15 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 87/255] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:37:15 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:50 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:37:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8a2465cb-76c7-4273-ab45-bb2e40f9ac6c tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 204 len: 0 microversion: 2.1 time: 0.116866 May 01 22:37:50 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:37:50 2023] DELETE /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "name": "network-vif-unplugged", "status": "completed", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] Creating event network-vif-unplugged:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:37:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-e4d7de71-d935-40e4-90c9-111218c970be req-ef2d5e62-6c77-4c70-ac1b-b4d1d7359c35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033505 May 01 22:37:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 88/257] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:37:50 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8da6affe-ac0a-4f42-99bc-190ef0140891 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 200 len: 1501 microversion: 2.1 time: 0.285143 May 01 22:37:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 86/258] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:37:50 2023] GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 1501 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-979201604", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "destination_type": "volume"}], "networks": [{"uuid": "7b537d45-40a4-4b68-9af9-58d63dce9c7b"}]}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] validate_networks() for [('7b537d45-40a4-4b68-9af9-58d63dce9c7b', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:37:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "name": "network-vif-plugged", "status": "completed", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}, {"server_uuid": "a0f9bce6-bacf-44cd-a18a-b9604bee6feb", "name": "network-vif-deleted", "tag": "13c1178d-8bce-4f81-b574-5f23697098d9"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:37:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Creating event network-vif-plugged:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:37:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] Creating event network-vif-deleted:13c1178d-8bce-4f81-b574-5f23697098d9 for instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb on user May 01 22:37:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-768cfc98-862f-4f46-997a-266343ebe00a req-02b5bb6e-3ee3-4e19-902b-f7e8991977f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030837 May 01 22:37:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 89/259] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:37:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Getting quotas for user d69bdbfb4f5844e1a5048ea211f81ac4 and project 91f2a1d522ca4a4a8adfaf09423dd719. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:37:52 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:37:52 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-525ce703-bf2c-4294-936c-e2052fe45712 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.768691 May 01 22:37:52 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 85/260] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:37:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:37:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:37:52 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:37:53 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:53 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:53 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:37:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e9fb31bf-199e-44af-a942-71d644ff2d88 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612" status: 200 len: 1394 microversion: 2.87 time: 0.427958 May 01 22:37:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 87/261] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:37:52 2023] GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612 => generated 1394 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:37:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebea7c3-6477-42ab-bc59-934bc8a04612", "tag": "af458f07-5e72-4c24-acfd-d248f3872cc7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:37:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] Creating event network-changed:af458f07-5e72-4c24-acfd-d248f3872cc7 for instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 on user May 01 22:37:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-4441e42b-7569-45a7-b229-069df7c57b76 req-838b94f9-b21b-480f-8c91-b97d49d73f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031101 May 01 22:37:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 90/262] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:37:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebea7c3-6477-42ab-bc59-934bc8a04612", "name": "network-vif-deleted", "tag": "af458f07-5e72-4c24-acfd-d248f3872cc7"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:37:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:37:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:37:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:37:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.compute.server_external_events [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] Unable to find a host for instance 7ebea7c3-6477-42ab-bc59-934bc8a04612. Dropping event network-vif-deleted {{(pid=61364) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} May 01 22:37:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-211300b6-9712-4503-b627-1b79591b366f req-47303f99-082d-4ad1-bbf6-60c9f65ff4a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091921 May 01 22:37:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 86/263] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:37:56 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2f0ef736-7614-401d-b1d0-168ef7e04c76 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.178471 May 01 22:38:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:38:11 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14/os-interface => generated 283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] Creating event network-changed:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:38:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-7b8ee7d2-fa73-4e1e-a24d-0ee26e01b418 req-09b14ead-7b62-407f-9297-29505d70c405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035490 May 01 22:38:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 91/265] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1871951835"}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-fe7c75ff-4495-44c9-9c87-87ddc3b2d9be tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14/action" status: 202 len: 0 microversion: 2.1 time: 0.713278 May 01 22:38:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 87/266] 10.0.0.210 () {64 vars in 1355 bytes} [Mon May 1 22:38:13 2023] POST /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) May 01 22:38:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9c4145d4-96ce-4dac-ad2a-e4288aa6a290 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '.version_select at 0x7fc7047e0b80>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:13 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-9c4145d4-96ce-4dac-ad2a-e4288aa6a290 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f" status: 200 len: 1609 microversion: 2.1 time: 0.045273 May 01 22:38:13 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 89/267] 10.0.0.210 () {62 vars in 1310 bytes} [Mon May 1 22:38:13 2023] GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f => generated 1609 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:16 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:16 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-146218ab-705b-4dac-bd64-3ec20d07c822 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.213549 May 01 22:38:16 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 92/268] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:38:15 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:16 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:16 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-adfb5aa5-e318-44b9-ad98-fec6a666b676 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.230345 May 01 22:38:16 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 88/269] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:38:16 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:16 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:16 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0286c0fc-8639-4ec8-8262-37c862ffd04e tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.225726 May 01 22:38:16 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 90/270] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:38:16 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] HTTP exception thrown: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Request method failure captured: May 01 22:38:40 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb HTTP/1.1 May 01 22:38:40 user devstack@n-api.service[61365]: Accept: application/json May 01 22:38:40 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:38:40 user devstack@n-api.service[61365]: Connection: close May 01 22:38:40 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:38:40 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:38:40 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:38:40 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:38:40 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:38:40 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD5e49O8x7Lea9d9ouhzNZ8tbbjzzDE8YIb0ENeJAlWjTNnZj_X2jcKe5jZinK-2x_lO2G-tJDt7bH9mHfxW6wvzEpIxqWaUUSjiC88i78MZsHucu2jSwJ9pFN52qaheJB-vf95k3xCvdvt4c1lsQrHJVnjln6r47e3h4aFlBAPgRwc May 01 22:38:40 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:38:40 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:38:40 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:38:40 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:38:40 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:38:40 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:38:40 user devstack@n-api.service[61365]: X-Project-Id: 751cec193a3945c785b177e032cfc758 May 01 22:38:40 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:38:40 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:38:40 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:38:40 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/751cec193a3945c785b177e032cfc758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:38:40 user devstack@n-api.service[61365]: X-Tenant: tempest-ServersNegativeTestJSON-1727673754 May 01 22:38:40 user devstack@n-api.service[61365]: X-Tenant-Id: 751cec193a3945c785b177e032cfc758 May 01 22:38:40 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:38:40 user devstack@n-api.service[61365]: X-User: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:38:40 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:38:40 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:38:40 user devstack@n-api.service[61365]: X-User-Id: 925c76f9d5114b489c630b78ff0b763f May 01 22:38:40 user devstack@n-api.service[61365]: X-User-Name: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:38:40 user devstack@n-api.service[61365]: method: > May 01 22:38:40 user devstack@n-api.service[61365]: exception: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:38:40 user devstack@n-api.service[61365]: action_args: {'id': 'a0f9bce6-bacf-44cd-a18a-b9604bee6feb'} May 01 22:38:40 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:38:40 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:38:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Returning 404 to user: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:38:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e1da9816-2711-48dd-ab56-338d551d0a91 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 404 len: 111 microversion: 2.1 time: 0.033223 May 01 22:38:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 93/271] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:38:40 2023] GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:41 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:41 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-113e5dcd-dbe9-4912-a2ab-4a079a08347f tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1493 microversion: 2.1 time: 0.935404 May 01 22:38:41 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 89/272] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:38:40 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1493 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.objects.instance [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lazy-loading 'fault' on Instance uuid 7ebea7c3-6477-42ab-bc59-934bc8a04612 {{(pid=61366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:43 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e2dfa20b-80e2-4401-8635-9509ca77a8ad tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612" status: 200 len: 1649 microversion: 2.87 time: 0.106856 May 01 22:38:43 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 91/273] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:38:43 2023] GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612 => generated 1649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Doing local delete in cell 3894b638-48b8-4a73-93b9-2ff19b42c5cd(cell1) {{(pid=61365) _delete /opt/stack/nova/nova/compute/api.py:2546}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:43 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] instance's host None is down, deleting from database May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] deallocate_for_instance() {{(pid=61365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Instance cache missing network info. {{(pid=61365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Updating instance_info_cache with network_info: [] {{(pid=61365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} May 01 22:38:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61365) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} May 01 22:38:43 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. May 01 22:38:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ba319b41-d0a5-416d-ac4a-4f8be2c663ec tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612" status: 204 len: 0 microversion: 2.87 time: 0.547517 May 01 22:38:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 94/274] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:38:43 2023] DELETE /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: 7ebea7c3-6477-42ab-bc59-934bc8a04612] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] HTTP exception thrown: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Request method failure captured: May 01 22:38:44 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612 HTTP/1.1 May 01 22:38:44 user devstack@n-api.service[61364]: Accept: application/json May 01 22:38:44 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:38:44 user devstack@n-api.service[61364]: Connection: close May 01 22:38:44 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:38:44 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:38:44 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:38:44 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:38:44 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:38:44 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD2onzlrG3KUcmS2ZNLOvgKGVcJup3_Lprj2R4GN9Trv_v7t74XcbMcfLEWHQtHCCetxPJtqm7lk28skhDV9nhRx7-XRSlukIsC1Y8yJGaMIebGD8R1KlrHXDlX1HWgDuI-_elht89ote7yz4JK62vgwn6fmKRd4oKhDeD_LAjK_2QY May 01 22:38:44 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:38:44 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:38:44 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:38:44 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:38:44 user devstack@n-api.service[61364]: X-Openstack-Nova-Api-Version: 2.87 May 01 22:38:44 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:38:44 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:38:44 user devstack@n-api.service[61364]: X-Project-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:38:44 user devstack@n-api.service[61364]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:38:44 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:38:44 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:38:44 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:38:44 user devstack@n-api.service[61364]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:38:44 user devstack@n-api.service[61364]: X-Tenant-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:38:44 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:38:44 user devstack@n-api.service[61364]: X-User: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:38:44 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:38:44 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:38:44 user devstack@n-api.service[61364]: X-User-Id: d69bdbfb4f5844e1a5048ea211f81ac4 May 01 22:38:44 user devstack@n-api.service[61364]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:38:44 user devstack@n-api.service[61364]: method: > May 01 22:38:44 user devstack@n-api.service[61364]: exception: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. May 01 22:38:44 user devstack@n-api.service[61364]: action_args: {'id': '7ebea7c3-6477-42ab-bc59-934bc8a04612'} May 01 22:38:44 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. May 01 22:38:44 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Returning 404 to user: Instance 7ebea7c3-6477-42ab-bc59-934bc8a04612 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:38:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-8d3ac636-0106-4889-a19d-fd239a048ad1 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612" status: 404 len: 111 microversion: 2.87 time: 0.027439 May 01 22:38:44 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 90/275] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:38:44 2023] GET /compute/v2.1/servers/7ebea7c3-6477-42ab-bc59-934bc8a04612 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:38:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-82a3115f-d420-4f4b-93d5-97f8e074ee3c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 204 len: 0 microversion: 2.87 time: 0.119914 May 01 22:38:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 92/276] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:38:44 2023] DELETE /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:44 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:38:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e8799888-39ed-4253-9cf8-a76eb34afcdd tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 200 len: 1697 microversion: 2.87 time: 0.320365 May 01 22:38:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 95/277] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:38:44 2023] GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "name": "network-vif-unplugged", "status": "completed", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] Creating event network-vif-unplugged:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:38:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-7005a561-7283-42e9-98ea-50932f9169ce req-63cc5474-4ded-4006-9c7a-3ace9737023e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032360 May 01 22:38:44 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 91/278] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:38:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:38:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "name": "network-vif-deleted", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:38:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] Creating event network-vif-deleted:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:38:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-e61c73bc-043e-4672-b14e-1702ea199c7c req-adc28417-de8e-4d58-bd09-e676ff79ecc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030812 May 01 22:38:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:38:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb62263c-ed42-4726-8c97-d3ad1fe2da78", "name": "network-vif-plugged", "status": "completed", "tag": "a90d148e-2a92-4eeb-96dd-e0f769f1d9c4"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:38:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:38:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:38:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:38:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] Creating event network-vif-plugged:a90d148e-2a92-4eeb-96dd-e0f769f1d9c4 for instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 on user May 01 22:38:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-a89cd718-2de7-4e44-8668-a6458a03e94f req-d383fdac-a81f-4cb3-a5ee-e6ae2b0379bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027570 May 01 22:38:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 96/280] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:39:03 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:03 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=10 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:03 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-c8f18353-7c30-4695-a9c5-ce0c60a6331f tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '.version_select at 0x7fc7047b0ca0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:03 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-c8f18353-7c30-4695-a9c5-ce0c60a6331f tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f" status: 200 len: 1723 microversion: 2.1 time: 0.058800 May 01 22:39:03 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 92/281] 10.0.0.210 () {62 vars in 1310 bytes} [Mon May 1 22:39:03 2023] GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f => generated 1723 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:39:03 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:03 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-56d7bf7a-90d0-4524-829b-9806384ea0ac tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '.version_select at 0x7fc7047e31c0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-56d7bf7a-90d0-4524-829b-9806384ea0ac tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f" status: 200 len: 1723 microversion: 2.1 time: 0.061135 May 01 22:39:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1310 bytes} [Mon May 1 22:39:03 2023] GET /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f => generated 1723 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:04 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118102d5bfbf420cbcb460d4ec476c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2860c5ee6a3d4273937790ee0537d4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ed599759-8006-411f-b01f-849c9c703a47 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 200 len: 1673 microversion: 2.1 time: 0.240447 May 01 22:39:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 97/283] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:39:04 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:18 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:18 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-3636526c-60fc-4fc1-9ea0-1f9077b32fc9 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.228445 May 01 22:39:18 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 93/284] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:39:18 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: bb62263c-ed42-4726-8c97-d3ad1fe2da78] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:34 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] HTTP exception thrown: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Request method failure captured: May 01 22:39:34 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 HTTP/1.1 May 01 22:39:34 user devstack@n-api.service[61366]: Accept: application/json May 01 22:39:34 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:39:34 user devstack@n-api.service[61366]: Connection: close May 01 22:39:34 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:39:34 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:39:34 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:39:34 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:39:34 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:39:34 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD2onzlrG3KUcmS2ZNLOvgKGVcJup3_Lprj2R4GN9Trv_v7t74XcbMcfLEWHQtHCCetxPJtqm7lk28skhDV9nhRx7-XRSlukIsC1Y8yJGaMIebGD8R1KlrHXDlX1HWgDuI-_elht89ote7yz4JK62vgwn6fmKRd4oKhDeD_LAjK_2QY May 01 22:39:34 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:39:34 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:39:34 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:39:34 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:39:34 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.87 May 01 22:39:34 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:39:34 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:39:34 user devstack@n-api.service[61366]: X-Project-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:39:34 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:39:34 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:39:34 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:39:34 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:39:34 user devstack@n-api.service[61366]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:39:34 user devstack@n-api.service[61366]: X-Tenant-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:39:34 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:39:34 user devstack@n-api.service[61366]: X-User: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:39:34 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:39:34 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:39:34 user devstack@n-api.service[61366]: X-User-Id: d69bdbfb4f5844e1a5048ea211f81ac4 May 01 22:39:34 user devstack@n-api.service[61366]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:39:34 user devstack@n-api.service[61366]: method: > May 01 22:39:34 user devstack@n-api.service[61366]: exception: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. May 01 22:39:34 user devstack@n-api.service[61366]: action_args: {'id': 'bb62263c-ed42-4726-8c97-d3ad1fe2da78'} May 01 22:39:34 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. May 01 22:39:34 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:39:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Returning 404 to user: Instance bb62263c-ed42-4726-8c97-d3ad1fe2da78 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:39:34 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-12c2c579-c900-41a6-8934-e729ab368cba tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78" status: 404 len: 111 microversion: 2.87 time: 0.031089 May 01 22:39:34 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:39:34 2023] GET /compute/v2.1/servers/bb62263c-ed42-4726-8c97-d3ad1fe2da78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:39:35 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-4ecb9644-5ed1-4d01-b075-257e80ae7e8c tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 204 len: 0 microversion: 2.87 time: 0.127851 May 01 22:39:35 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 98/286] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:39:35 2023] DELETE /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:35 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69bdbfb4f5844e1a5048ea211f81ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2a1d522ca4a4a8adfaf09423dd719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:35 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "name": "network-vif-unplugged", "status": "completed", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:39:35 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e9855a8d-d9d1-44cd-8ea5-a35c7a9d236e tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 200 len: 1697 microversion: 2.87 time: 0.250061 May 01 22:39:35 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 94/287] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:39:35 2023] GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 1697 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:39:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] Creating event network-vif-unplugged:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:39:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-76672017-ba1e-46fa-a3c4-a166aa9ae25b req-f12c6101-5bee-42e3-b672-f86fb5293311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027231 May 01 22:39:35 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:39:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "name": "network-vif-deleted", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:39:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] Creating event network-vif-deleted:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:39:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-57a8eb72-5cc9-4d34-aa1f-1786b5419b8f req-44e8e75f-cf45-4766-9483-af2bd2a6539d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038240 May 01 22:39:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 99/289] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:39:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469561c-96f7-427f-ba64-7aa93df4efc7", "name": "network-vif-plugged", "status": "completed", "tag": "ed105032-ef13-4c36-984e-604f0a4fce5b"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:39:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:37 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] Creating event network-vif-plugged:ed105032-ef13-4c36-984e-604f0a4fce5b for instance b469561c-96f7-427f-ba64-7aa93df4efc7 on user May 01 22:39:37 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-73dda0d4-5c57-4e0c-9684-60dc39c3a9b9 req-8e48ed3d-5550-4e99-96d6-e40e502ad504 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029843 May 01 22:39:37 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 95/290] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:39:43 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:39:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-367c6482-07d9-43c5-897d-6ae548534498 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1493 microversion: 2.1 time: 0.231740 May 01 22:39:43 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 97/291] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:39:43 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1493 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:05 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118102d5bfbf420cbcb460d4ec476c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2860c5ee6a3d4273937790ee0537d4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:05 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fda17f91-9781-4c24-9b61-4e89fd3ae0c7 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 200 len: 1673 microversion: 2.1 time: 0.403321 May 01 22:40:05 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 100/292] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:04 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 1673 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:06 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:06 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:06 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-dbbbc060-c52f-4583-8a0a-699d6c79009b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '.version_select at 0x7fc7047b0820>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:06 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-dbbbc060-c52f-4583-8a0a-699d6c79009b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f" status: 204 len: 0 microversion: 2.1 time: 0.229613 May 01 22:40:06 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 96/293] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:06 2023] DELETE /compute/v2.1/images/46da2d53-1ffe-4d3a-896a-320c8b8f702f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:06 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:40:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f01b1547-bd11-4ad1-9426-33322798028b tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 204 len: 0 microversion: 2.1 time: 0.146824 May 01 22:40:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:40:06 2023] DELETE /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:07 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118102d5bfbf420cbcb460d4ec476c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2860c5ee6a3d4273937790ee0537d4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-972b2ee9-7edd-47ca-9395-660ce8568947 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 200 len: 1679 microversion: 2.1 time: 0.169927 May 01 22:40:07 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 101/295] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:07 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:07 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "name": "network-vif-unplugged", "status": "completed", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:07 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:07 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] Creating event network-vif-unplugged:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:40:07 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-e7d63d12-6e5b-4153-a9f1-5a2a04e65007 req-39acf2cd-25a3-4b70-94b6-a17b5dd6950e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030096 May 01 22:40:07 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 97/296] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:40:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "name": "network-vif-deleted", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] Creating event network-vif-deleted:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:40:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-2fab0f4b-75c2-4c6b-a1cf-3ab25b4d2996 req-fc0fb71e-7125-498f-8d68-c45d245a1e1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 May 01 22:40:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:09 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb72876a-85e4-4fa5-8e21-9b51f49aef14", "name": "network-vif-plugged", "status": "completed", "tag": "f9b7466a-899d-435d-9d5f-3b4635f56d39"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] Creating event network-vif-plugged:f9b7466a-899d-435d-9d5f-3b4635f56d39 for instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 on user May 01 22:40:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-50ee6595-250d-461d-8520-804440273b5c req-ae33d982-688e-498b-986e-4529bb3db601 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030783 May 01 22:40:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 102/298] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:18 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:18 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-6e8f7995-a278-434f-a46d-f7b6d6a078ec tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.336472 May 01 22:40:18 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 98/299] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:18 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:19 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-df6a9466-835e-4be0-8e46-b0feb4766ca6 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.265766 May 01 22:40:19 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:18 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:19 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-af3badec-d2e8-4c39-825d-3e83de4047a5 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.229941 May 01 22:40:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:19 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] [instance: b469561c-96f7-427f-ba64-7aa93df4efc7] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:25 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] HTTP exception thrown: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Request method failure captured: May 01 22:40:25 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 HTTP/1.1 May 01 22:40:25 user devstack@n-api.service[61364]: Accept: application/json May 01 22:40:25 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:40:25 user devstack@n-api.service[61364]: Connection: close May 01 22:40:25 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:40:25 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:40:25 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:40:25 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:40:25 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:40:25 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD2onzlrG3KUcmS2ZNLOvgKGVcJup3_Lprj2R4GN9Trv_v7t74XcbMcfLEWHQtHCCetxPJtqm7lk28skhDV9nhRx7-XRSlukIsC1Y8yJGaMIebGD8R1KlrHXDlX1HWgDuI-_elht89ote7yz4JK62vgwn6fmKRd4oKhDeD_LAjK_2QY May 01 22:40:25 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:40:25 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:40:25 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:40:25 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:40:25 user devstack@n-api.service[61364]: X-Openstack-Nova-Api-Version: 2.87 May 01 22:40:25 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:40:25 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:40:25 user devstack@n-api.service[61364]: X-Project-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:40:25 user devstack@n-api.service[61364]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:40:25 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:40:25 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:40:25 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f2a1d522ca4a4a8adfaf09423dd719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:40:25 user devstack@n-api.service[61364]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:40:25 user devstack@n-api.service[61364]: X-Tenant-Id: 91f2a1d522ca4a4a8adfaf09423dd719 May 01 22:40:25 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635 May 01 22:40:25 user devstack@n-api.service[61364]: X-User: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:40:25 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:40:25 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:40:25 user devstack@n-api.service[61364]: X-User-Id: d69bdbfb4f5844e1a5048ea211f81ac4 May 01 22:40:25 user devstack@n-api.service[61364]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member May 01 22:40:25 user devstack@n-api.service[61364]: method: > May 01 22:40:25 user devstack@n-api.service[61364]: exception: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. May 01 22:40:25 user devstack@n-api.service[61364]: action_args: {'id': 'b469561c-96f7-427f-ba64-7aa93df4efc7'} May 01 22:40:25 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. May 01 22:40:25 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:40:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] Returning 404 to user: Instance b469561c-96f7-427f-ba64-7aa93df4efc7 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:40:25 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e8ed0a1f-ca58-4e35-8ee0-611431ccc6f6 tempest-ServerBootFromVolumeStableRescueTest-245268635 tempest-ServerBootFromVolumeStableRescueTest-245268635-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7" status: 404 len: 111 microversion: 2.87 time: 0.042010 May 01 22:40:25 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 99/302] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:40:25 2023] GET /compute/v2.1/servers/b469561c-96f7-427f-ba64-7aa93df4efc7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:40:36 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:36 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:36 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1124257453", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:36 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] validate_networks() for [('1974467f-b201-44b2-9fd9-eb999d2e236c', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Getting quotas for project 3b813d8c60794ed481b464a012aeb601. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Getting quotas for user 51b0b49ccd7f4a8bae43dab2f309403e and project 3b813d8c60794ed481b464a012aeb601. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:40:37 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:40:37 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8d85a863-b7af-4855-97e0-36ae5e6e5c18 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.763718 May 01 22:40:37 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 101/303] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:40:36 2023] POST /compute/v2.1/servers => generated 381 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:40:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-782ea9e6-84b7-4e97-9e9c-c8d8c6dd10e1 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:37 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-782ea9e6-84b7-4e97-9e9c-c8d8c6dd10e1 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:37 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:37 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=20 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:37 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-782ea9e6-84b7-4e97-9e9c-c8d8c6dd10e1 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-782ea9e6-84b7-4e97-9e9c-c8d8c6dd10e1 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1" status: 200 len: 1216 microversion: 2.1 time: 0.080893 May 01 22:40:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 104/304] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:37 2023] GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-18660917", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] validate_networks() for [('1974467f-b201-44b2-9fd9-eb999d2e236c', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Getting quotas for project 3b813d8c60794ed481b464a012aeb601. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Getting quotas for user 51b0b49ccd7f4a8bae43dab2f309403e and project 3b813d8c60794ed481b464a012aeb601. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:40:37 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:40:38 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-5692cd9b-de87-4a59-bfc9-69f23f2520b6 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.571612 May 01 22:40:38 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 100/305] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:40:37 2023] POST /compute/v2.1/servers => generated 381 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:40:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9a066e9f-7012-4c3f-a426-390c03c12ed4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:38 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-9a066e9f-7012-4c3f-a426-390c03c12ed4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:38 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-9a066e9f-7012-4c3f-a426-390c03c12ed4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-9a066e9f-7012-4c3f-a426-390c03c12ed4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 200 len: 1214 microversion: 2.1 time: 0.070260 May 01 22:40:38 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:38 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:39 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:39 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] Creating event network-changed:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:40:39 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-3824d993-8dde-4214-89ce-9950b0de0557 req-a2d207bc-6be5-4d93-ab49-2f800a11f2f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036648 May 01 22:40:39 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:40 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:40 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] Creating event network-changed:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:40:40 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-74fd8069-99cc-48ce-8ba2-27c0d004f692 req-e6dc3597-d084-47bb-b06c-d04a196143af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094358 May 01 22:40:40 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 101/308] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:42 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "name": "network-vif-plugged", "status": "completed", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:42 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] Creating event network-vif-plugged:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:40:42 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-30b322fb-a166-4bec-8454-12cb0a588891 req-e082167f-6aae-44ae-8a0c-06d4b7d10ae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029704 May 01 22:40:42 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:43 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:40:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-2c40a26b-055b-44ec-a0f9-4c38244551e8 req-6e3f4383-092a-49aa-ad49-dee31d9076da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045940 May 01 22:40:43 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 102/310] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:43 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:40:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-41f56b1c-3e06-4338-bfd0-5bab1004438e tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1493 microversion: 2.1 time: 0.224447 May 01 22:40:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 106/311] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:43 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1493 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:40:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "name": "network-vif-plugged", "status": "completed", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] Creating event network-vif-plugged:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:40:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-842bfb58-03ff-49ed-b36c-222e60212081 req-90a66150-31d5-4eb6-b6be-27ee31dc9e41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029450 May 01 22:40:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 104/312] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:45 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:40:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:45 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:40:45 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-90182db2-2315-42d1-b094-f5732380893f req-73e8936b-1b04-4fd7-bc37-98c5c67b7322 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028497 May 01 22:40:45 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 103/313] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] [instance: cb72876a-85e4-4fa5-8e21-9b51f49aef14] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:40:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] HTTP exception thrown: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Request method failure captured: May 01 22:40:57 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 HTTP/1.1 May 01 22:40:57 user devstack@n-api.service[61365]: Accept: application/json May 01 22:40:57 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:40:57 user devstack@n-api.service[61365]: Connection: close May 01 22:40:57 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:40:57 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:40:57 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:40:57 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:40:57 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:40:57 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD7j61-F1fIXbA-vW1Wa80ndAw5ZRIUxU66_YbicF6dQcgLVqfCOLfJjwXY388eShK8a0xyMebuxWu7TnkESHQ0C6xZwf6NtdtFOx1gBr4_Q1UBWcEXFWFEFtfSpq2dfCezALLUDY5K4lQtPbyc1mj4WYh2tAciKy9R80utkPvBzFqc May 01 22:40:57 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:40:57 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:40:57 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:40:57 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:40:57 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:40:57 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:40:57 user devstack@n-api.service[61365]: X-Project-Id: 2860c5ee6a3d4273937790ee0537d4ab May 01 22:40:57 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServerStableDeviceRescueTest-306736343 May 01 22:40:57 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:40:57 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:40:57 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2860c5ee6a3d4273937790ee0537d4ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2860c5ee6a3d4273937790ee0537d4ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2860c5ee6a3d4273937790ee0537d4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:40:57 user devstack@n-api.service[61365]: X-Tenant: tempest-ServerStableDeviceRescueTest-306736343 May 01 22:40:57 user devstack@n-api.service[61365]: X-Tenant-Id: 2860c5ee6a3d4273937790ee0537d4ab May 01 22:40:57 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-306736343 May 01 22:40:57 user devstack@n-api.service[61365]: X-User: tempest-ServerStableDeviceRescueTest-306736343-project-member May 01 22:40:57 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:40:57 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:40:57 user devstack@n-api.service[61365]: X-User-Id: 118102d5bfbf420cbcb460d4ec476c00 May 01 22:40:57 user devstack@n-api.service[61365]: X-User-Name: tempest-ServerStableDeviceRescueTest-306736343-project-member May 01 22:40:57 user devstack@n-api.service[61365]: method: > May 01 22:40:57 user devstack@n-api.service[61365]: exception: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. May 01 22:40:57 user devstack@n-api.service[61365]: action_args: {'id': 'cb72876a-85e4-4fa5-8e21-9b51f49aef14'} May 01 22:40:57 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. May 01 22:40:57 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:40:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Returning 404 to user: Instance cb72876a-85e4-4fa5-8e21-9b51f49aef14 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:40:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-99ab4bb1-b6e3-4609-a394-7e93c2f81a84 tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14" status: 404 len: 111 microversion: 2.1 time: 0.035973 May 01 22:40:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 107/314] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:40:57 2023] GET /compute/v2.1/servers/cb72876a-85e4-4fa5-8e21-9b51f49aef14 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:40:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:40:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2554968e-fe43-40b5-8119-42e23a1da39c tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] Calling method '.version_select at 0x7fc704632dd0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:40:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2554968e-fe43-40b5-8119-42e23a1da39c tempest-ServerStableDeviceRescueTest-306736343 tempest-ServerStableDeviceRescueTest-306736343-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352999903" status: 202 len: 0 microversion: 2.1 time: 0.029471 May 01 22:40:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 105/315] 10.0.0.210 () {62 vars in 1298 bytes} [Mon May 1 22:40:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352999903 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:41:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:02 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-d448fd89-e57b-447e-908b-3f815547e026 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Action: 'create', calling method: .version_select at 0x7fc7047b11b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-650828014"}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:41:02 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-d448fd89-e57b-447e-908b-3f815547e026 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.449383 May 01 22:41:02 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 104/316] 10.0.0.210 () {64 vars in 1232 bytes} [Mon May 1 22:41:02 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) May 01 22:41:02 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b5415441-04dd-43c2-afa4-082e1a360f23 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Calling method '.version_select at 0x7fc70459ea70>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:02 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b5415441-04dd-43c2-afa4-082e1a360f23 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2" status: 200 len: 341 microversion: 2.1 time: 0.049587 May 01 22:41:02 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 108/317] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:41:02 2023] GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 => generated 341 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:41:03 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0be2c77a-7497-4d4a-9901-b5eda16d3786 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Calling method '.version_select at 0x7fc704631360>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0be2c77a-7497-4d4a-9901-b5eda16d3786 tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2" status: 200 len: 341 microversion: 2.1 time: 0.162309 May 01 22:41:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 106/318] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:41:03 2023] GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 => generated 341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:41:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e4d8e134-aee6-4a3c-884f-4decf968d2cd tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Calling method '.version_select at 0x7fc704639630>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:04 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e4d8e134-aee6-4a3c-884f-4decf968d2cd tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2" status: 202 len: 0 microversion: 2.1 time: 0.111799 May 01 22:41:04 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 105/319] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:41:04 2023] DELETE /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:41:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e6195f7e-c5fa-4f71-b73c-dfe516bcea5f tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Calling method '.version_select at 0x7fc7047557e0>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-e6195f7e-c5fa-4f71-b73c-dfe516bcea5f tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] HTTP exception thrown: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. May 01 22:41:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e6195f7e-c5fa-4f71-b73c-dfe516bcea5f tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Request method failure captured: May 01 22:41:04 user devstack@n-api.service[61365]: request: GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 HTTP/1.1 May 01 22:41:04 user devstack@n-api.service[61365]: Accept: application/json May 01 22:41:04 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:41:04 user devstack@n-api.service[61365]: Connection: close May 01 22:41:04 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:41:04 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:41:04 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:41:04 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:41:04 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:41:04 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD_-7lr_CIBu0x6woY_P785MKh2nJl2Lic3fpQLZPqGsNDs9ZiILikMnljEBCMaZ8UuEZ3y_ECgJRz4MBXPPG-j-a_h8hr5MyVPFRUHGbFM6jCe6KN6SdIBnjP3ORN2T8VhAiOXY00skNX72Y0G2rEWK1vidd-_nTcJ7PeBA1CcmXe8 May 01 22:41:04 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:41:04 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:41:04 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:41:04 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:41:04 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:41:04 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:41:04 user devstack@n-api.service[61365]: X-Project-Id: c72758567a994aceb51587fb8883dc4e May 01 22:41:04 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-173499837 May 01 22:41:04 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:41:04 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:41:04 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72758567a994aceb51587fb8883dc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72758567a994aceb51587fb8883dc4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72758567a994aceb51587fb8883dc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:41:04 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesSnapshotsTestJSON-173499837 May 01 22:41:04 user devstack@n-api.service[61365]: X-Tenant-Id: c72758567a994aceb51587fb8883dc4e May 01 22:41:04 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-173499837 May 01 22:41:04 user devstack@n-api.service[61365]: X-User: tempest-VolumesSnapshotsTestJSON-173499837-project-member May 01 22:41:04 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:41:04 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:41:04 user devstack@n-api.service[61365]: X-User-Id: f1d378a360e24819b272dcadc703702c May 01 22:41:04 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesSnapshotsTestJSON-173499837-project-member May 01 22:41:04 user devstack@n-api.service[61365]: method: May 01 22:41:04 user devstack@n-api.service[61365]: exception: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. May 01 22:41:04 user devstack@n-api.service[61365]: action_args: {'id': 'a86fae7f-ba1c-40e0-977a-b96f8c1d46c2'} May 01 22:41:04 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. (HTTP 404) (Request-ID: req-697a88ab-e535-48a4-89bb-b556e171cae1) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. May 01 22:41:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:41:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e6195f7e-c5fa-4f71-b73c-dfe516bcea5f tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] Returning 404 to user: Volume a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:41:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e6195f7e-c5fa-4f71-b73c-dfe516bcea5f tempest-VolumesSnapshotsTestJSON-173499837 tempest-VolumesSnapshotsTestJSON-173499837-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2" status: 404 len: 109 microversion: 2.1 time: 0.031843 May 01 22:41:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 109/320] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:41:04 2023] GET /compute/v2.1/os-volumes/a86fae7f-ba1c-40e0-977a-b96f8c1d46c2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:41:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1074487243", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "networks": [{"uuid": "05cd335d-8348-4871-8058-997a1ebe3aaa"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:41:20 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] validate_networks() for [('05cd335d-8348-4871-8058-997a1ebe3aaa', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:41:20 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:41:20 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Getting quotas for project 33d82b559d33412cb017588ae66ea7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Getting quotas for user 272675f44644423aa2e33baf43ed76de and project 33d82b559d33412cb017588ae66ea7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:41:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:41:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-363c1d15-876c-4cf3-b0f1-c774fc2f8862 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.662741 May 01 22:41:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 107/321] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:41:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:41:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-5cd73e91-e4e7-4980-a515-362522e7aae2 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-5cd73e91-e4e7-4980-a515-362522e7aae2 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:41:21 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-5cd73e91-e4e7-4980-a515-362522e7aae2 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272675f44644423aa2e33baf43ed76de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d82b559d33412cb017588ae66ea7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:41:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-5cd73e91-e4e7-4980-a515-362522e7aae2 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407" status: 200 len: 1208 microversion: 2.1 time: 0.081082 May 01 22:41:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 110/322] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:41:21 2023] GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:41:21 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:41:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-0376fd7f-8bf6-4d5b-be14-ea51c34a5b6c tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1655 microversion: 2.1 time: 0.267791 May 01 22:41:21 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 106/323] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:41:21 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1655 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:41:23 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:41:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] Creating event network-changed:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:41:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4b291c0e-7a6f-46f3-b954-613c5c7a59cf req-9becdca0-4c6d-4515-b25e-d4ce2cbbe585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030728 May 01 22:41:23 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 108/324] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:41:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:41:25 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "name": "network-vif-plugged", "status": "completed", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:41:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:25 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] Creating event network-vif-plugged:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:41:25 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9daeb53e-0a62-4877-88e3-74c4be76c36a req-395e75de-4902-4ee7-8bae-1beaf0aa45f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 May 01 22:41:25 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 111/325] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:41:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:41:27 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "name": "network-vif-plugged", "status": "completed", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:41:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:27 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] Creating event network-vif-plugged:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:41:27 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-ffd60b6a-b763-4d34-99e1-19d22cfcc673 req-2b487429-88c9-43ab-a9c1-f64b7b168a47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 May 01 22:41:27 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 107/326] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:41:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:28 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:41:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c70f42d8-958b-4bfa-a692-c2671456b83d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 200 len: 1502 microversion: 2.1 time: 0.220657 May 01 22:41:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 109/327] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:41:28 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:41:45 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:41:45 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-aab8326f-6add-4cec-aea3-fb7b47325b07 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1493 microversion: 2.1 time: 0.234412 May 01 22:41:45 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:41:45 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:42:11 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:42:11 user devstack@n-api.service[61364]: Mon May 1 22:42:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 (ip 10.0.0.210) !!! May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:11 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272675f44644423aa2e33baf43ed76de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d82b559d33412cb017588ae66ea7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:42:11 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-fe5336a1-0e73-414b-9b97-5aead0c01b39 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407" status: 200 len: 1486 microversion: 2.1 time: 0.240063 May 01 22:42:11 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 108/329] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:42:11 2023] GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 => generated 1486 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:42:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-41d11d7c-c2d6-4565-b90d-dab0255f09eb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 204 len: 0 microversion: 2.1 time: 0.187076 May 01 22:42:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:42:21 2023] DELETE /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "name": "network-vif-unplugged", "status": "completed", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:22 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7783d0250c8b4c54b2765b690a00180c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d89fb5a174f6ba5b8be3efedae82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:22 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-5adaf7b9-8970-401f-95ae-814b2f7ca8bb tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 200 len: 1661 microversion: 2.1 time: 0.391227 May 01 22:42:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 113/331] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:42:21 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 1661 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:42:22 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] Creating event network-vif-unplugged:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:42:22 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-663e9b6e-f729-4b0d-975f-816dd8ba298b req-28d65524-628a-4f42-a9a3-8bbea385c6bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034194 May 01 22:42:22 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 109/332] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:24 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "name": "network-vif-plugged", "status": "completed", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}, {"server_uuid": "6a31700e-3d91-43dc-8b68-a464a65ac384", "name": "network-vif-deleted", "tag": "64205a33-5e88-46a5-8578-f427b4a69fd9"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Creating event network-vif-plugged:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:42:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] Creating event network-vif-deleted:64205a33-5e88-46a5-8578-f427b4a69fd9 for instance 6a31700e-3d91-43dc-8b68-a464a65ac384 on user May 01 22:42:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-63b3a7a2-6f9c-428e-a8a3-d9d449e92f6d req-d827032c-93a5-4726-a588-6f49d9f73e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030306 May 01 22:42:24 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 111/333] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:28 user devstack@n-api.service[61365]: DEBUG nova.objects.instance [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lazy-loading 'flavor' on Instance uuid 3682d5e0-02a8-4b92-8c8d-81f86414dbbc {{(pid=61365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} May 01 22:42:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-31ca9b4d-9f3f-4563-90f6-5926f7be12fc tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc/action" status: 200 len: 32 microversion: 2.1 time: 0.137417 May 01 22:42:28 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 114/334] 10.0.0.210 () {64 vars in 1355 bytes} [Mon May 1 22:42:28 2023] POST /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:28 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:42:28 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-57f012a0-52e1-4672-bfc5-58f0c230f49e tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 200 len: 1508 microversion: 2.1 time: 0.361348 May 01 22:42:28 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 110/335] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:42:28 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:42:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] Creating event network-vif-unplugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a1b9b52d-2b07-4df6-aa65-bbe56f85089d req-60faf10e-3050-417a-b7b0-995160cfa735 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135788 May 01 22:42:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:31 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}, {"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}, {"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}, {"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}, {"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Creating event network-vif-unplugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-a0d0a789-d3d7-49ce-8b0f-d42358119f78 req-af9fc906-224d-4ec2-b8ac-82f93e5f1783 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037645 May 01 22:42:31 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:31 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:33 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}, {"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:33 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:33 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:33 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:33 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:33 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:42:33 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-cbe8a45a-38a1-4e58-a38d-5b67d335e04a req-46bb5424-ace6-446a-a410-9324a34234e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029010 May 01 22:42:33 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 111/338] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] HTTP exception thrown: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Request method failure captured: May 01 22:42:45 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb HTTP/1.1 May 01 22:42:45 user devstack@n-api.service[61366]: Accept: application/json May 01 22:42:45 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:42:45 user devstack@n-api.service[61366]: Connection: close May 01 22:42:45 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:42:45 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:42:45 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:42:45 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:42:45 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:42:45 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD5e49O8x7Lea9d9ouhzNZ8tbbjzzDE8YIb0ENeJAlWjTNnZj_X2jcKe5jZinK-2x_lO2G-tJDt7bH9mHfxW6wvzEpIxqWaUUSjiC88i78MZsHucu2jSwJ9pFN52qaheJB-vf95k3xCvdvt4c1lsQrHJVnjln6r47e3h4aFlBAPgRwc May 01 22:42:45 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:42:45 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:42:45 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:42:45 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:42:45 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:42:45 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:42:45 user devstack@n-api.service[61366]: X-Project-Id: 751cec193a3945c785b177e032cfc758 May 01 22:42:45 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:42:45 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:42:45 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/751cec193a3945c785b177e032cfc758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:42:45 user devstack@n-api.service[61366]: X-Tenant: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61366]: X-Tenant-Id: 751cec193a3945c785b177e032cfc758 May 01 22:42:45 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61366]: X-User: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:42:45 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:42:45 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:42:45 user devstack@n-api.service[61366]: X-User-Id: 925c76f9d5114b489c630b78ff0b763f May 01 22:42:45 user devstack@n-api.service[61366]: X-User-Name: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:42:45 user devstack@n-api.service[61366]: method: > May 01 22:42:45 user devstack@n-api.service[61366]: exception: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61366]: action_args: {'id': 'a0f9bce6-bacf-44cd-a18a-b9604bee6feb'} May 01 22:42:45 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Returning 404 to user: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:42:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-24ea2704-0513-4ca4-8d03-0f1a2b27d9a6 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 404 len: 111 microversion: 2.1 time: 0.043302 May 01 22:42:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 113/339] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:42:45 2023] DELETE /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: a0f9bce6-bacf-44cd-a18a-b9604bee6feb] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] HTTP exception thrown: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Request method failure captured: May 01 22:42:45 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb HTTP/1.1 May 01 22:42:45 user devstack@n-api.service[61365]: Accept: application/json May 01 22:42:45 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:42:45 user devstack@n-api.service[61365]: Connection: close May 01 22:42:45 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:42:45 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:42:45 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:42:45 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:42:45 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:42:45 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD5e49O8x7Lea9d9ouhzNZ8tbbjzzDE8YIb0ENeJAlWjTNnZj_X2jcKe5jZinK-2x_lO2G-tJDt7bH9mHfxW6wvzEpIxqWaUUSjiC88i78MZsHucu2jSwJ9pFN52qaheJB-vf95k3xCvdvt4c1lsQrHJVnjln6r47e3h4aFlBAPgRwc May 01 22:42:45 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:42:45 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:42:45 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:42:45 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:42:45 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:42:45 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:42:45 user devstack@n-api.service[61365]: X-Project-Id: 751cec193a3945c785b177e032cfc758 May 01 22:42:45 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:42:45 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:42:45 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/751cec193a3945c785b177e032cfc758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:42:45 user devstack@n-api.service[61365]: X-Tenant: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61365]: X-Tenant-Id: 751cec193a3945c785b177e032cfc758 May 01 22:42:45 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:42:45 user devstack@n-api.service[61365]: X-User: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:42:45 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:42:45 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:42:45 user devstack@n-api.service[61365]: X-User-Id: 925c76f9d5114b489c630b78ff0b763f May 01 22:42:45 user devstack@n-api.service[61365]: X-User-Name: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:42:45 user devstack@n-api.service[61365]: method: > May 01 22:42:45 user devstack@n-api.service[61365]: exception: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61365]: action_args: {'id': 'a0f9bce6-bacf-44cd-a18a-b9604bee6feb'} May 01 22:42:45 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. May 01 22:42:45 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:42:45 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Returning 404 to user: Instance a0f9bce6-bacf-44cd-a18a-b9604bee6feb could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:42:45 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-42641270-f43d-4655-b0e4-7c87fdb90e64 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb" status: 404 len: 111 microversion: 2.1 time: 0.035255 May 01 22:42:45 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 116/340] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:42:45 2023] GET /compute/v2.1/servers/a0f9bce6-bacf-44cd-a18a-b9604bee6feb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=10 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:42:45 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-c12cf322-6e50-451e-a6b7-c2989e9cd627 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 204 len: 0 microversion: 2.1 time: 0.121799 May 01 22:42:45 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:42:45 2023] DELETE /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "name": "network-vif-unplugged", "status": "completed", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] Creating event network-vif-unplugged:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:42:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-97f95619-adf5-40a1-9622-80b65eb0630a req-6f8bfcec-9ad5-4d21-b301-3b0f2fe515d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033039 May 01 22:42:46 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925c76f9d5114b489c630b78ff0b763f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cec193a3945c785b177e032cfc758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:42:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 117/342] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-4f0cdccc-5e35-41f7-b237-14d8a5d7c55d tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 200 len: 1499 microversion: 2.1 time: 0.625645 May 01 22:42:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:42:45 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 1499 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:42:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "name": "network-vif-deleted", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] Creating event network-vif-deleted:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:42:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-cd406f53-e97b-4356-ba29-080603afb9b7 req-50db353d-8070-44c5-b9aa-ad7d5042e33e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029155 May 01 22:42:46 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 113/344] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:42:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02", "name": "network-vif-plugged", "status": "completed", "tag": "2e397042-94c4-4480-86f1-1f05d1b3d4b5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:42:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:42:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:42:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:42:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] Creating event network-vif-plugged:2e397042-94c4-4480-86f1-1f05d1b3d4b5 for instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 on user May 01 22:42:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-82e9d729-df0b-4a63-986a-5740467ea7d5 req-96b25adf-1163-48fc-9d4f-bfe0f5ef4a9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027920 May 01 22:42:48 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 118/345] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] [instance: 6a31700e-3d91-43dc-8b68-a464a65ac384] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] HTTP exception thrown: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Request method failure captured: May 01 22:43:12 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 HTTP/1.1 May 01 22:43:12 user devstack@n-api.service[61366]: Accept: application/json May 01 22:43:12 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:43:12 user devstack@n-api.service[61366]: Connection: close May 01 22:43:12 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:43:12 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:43:12 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:43:12 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:43:12 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:43:12 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUD45LAA5a4DsShLA1qnfxB1EpmpRDPd_QjmlxGQSwi966Y4PGM7Obf_GNUNdBjb43axdpueo-D2-OZc0sINS-AjQPFrmWhhDQxUy4CDxy5JXoi2g6V7loVej7slz_Mv1bRvtBRZnEymjKCCUdyElqLwSQexx483RvoIBqB8b81dSCzo May 01 22:43:12 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:43:12 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:43:12 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:43:12 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:43:12 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:43:12 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:43:12 user devstack@n-api.service[61366]: X-Project-Id: 735d89fb5a174f6ba5b8be3efedae82b May 01 22:43:12 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServerActionsTestJSON-1477286187 May 01 22:43:12 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:43:12 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:43:12 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/735d89fb5a174f6ba5b8be3efedae82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/735d89fb5a174f6ba5b8be3efedae82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/735d89fb5a174f6ba5b8be3efedae82b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:43:12 user devstack@n-api.service[61366]: X-Tenant: tempest-ServerActionsTestJSON-1477286187 May 01 22:43:12 user devstack@n-api.service[61366]: X-Tenant-Id: 735d89fb5a174f6ba5b8be3efedae82b May 01 22:43:12 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServerActionsTestJSON-1477286187 May 01 22:43:12 user devstack@n-api.service[61366]: X-User: tempest-ServerActionsTestJSON-1477286187-project-member May 01 22:43:12 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:43:12 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:43:12 user devstack@n-api.service[61366]: X-User-Id: 7783d0250c8b4c54b2765b690a00180c May 01 22:43:12 user devstack@n-api.service[61366]: X-User-Name: tempest-ServerActionsTestJSON-1477286187-project-member May 01 22:43:12 user devstack@n-api.service[61366]: method: > May 01 22:43:12 user devstack@n-api.service[61366]: exception: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. May 01 22:43:12 user devstack@n-api.service[61366]: action_args: {'id': '6a31700e-3d91-43dc-8b68-a464a65ac384'} May 01 22:43:12 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. May 01 22:43:12 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Returning 404 to user: Instance 6a31700e-3d91-43dc-8b68-a464a65ac384 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:43:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-7741c2a8-5a7f-45c9-a8d1-3270ffc44145 tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384" status: 404 len: 111 microversion: 2.1 time: 0.032254 May 01 22:43:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 115/346] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:43:12 2023] GET /compute/v2.1/servers/6a31700e-3d91-43dc-8b68-a464a65ac384 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:43:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:12 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:12 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-16d01ae4-1209-4e8f-92cf-282c9e3f899a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] Calling method '.version_select at 0x7fc7047b1e10>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-16d01ae4-1209-4e8f-92cf-282c9e3f899a tempest-ServerActionsTestJSON-1477286187 tempest-ServerActionsTestJSON-1477286187-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805154829" status: 202 len: 0 microversion: 2.1 time: 0.033951 May 01 22:43:12 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 114/347] 10.0.0.210 () {62 vars in 1295 bytes} [Mon May 1 22:43:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805154829 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:13 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:43:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ac564df1-6e20-4ed8-925c-8d52fc2c37a8 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407" status: 204 len: 0 microversion: 2.1 time: 0.125706 May 01 22:43:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 119/348] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:43:13 2023] DELETE /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "name": "network-vif-unplugged", "status": "completed", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:43:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] Creating event network-vif-unplugged:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:43:13 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-b93c22ef-316d-4377-b1f3-42fad93bc08b req-8108f482-a356-4694-844e-279b3c3ab0db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086184 May 01 22:43:13 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 115/349] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:43:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:13 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272675f44644423aa2e33baf43ed76de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d82b559d33412cb017588ae66ea7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:43:13 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-9ca4af19-4e29-4062-bee1-e13100268ac9 tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407" status: 200 len: 1492 microversion: 2.1 time: 0.637213 May 01 22:43:13 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:43:13 2023] GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 => generated 1492 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:43:14 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "name": "network-vif-deleted", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:43:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] Creating event network-vif-deleted:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:43:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-89ab2502-d3ae-43a3-98c9-22dbbe2cf2f4 req-ef53d45f-cb64-43b8-80bc-92290abf37e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028732 May 01 22:43:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 120/351] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:15 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f59b0b-3deb-48c7-9695-5727fa720407", "name": "network-vif-plugged", "status": "completed", "tag": "c29e56c1-1810-4b73-bcb9-fcf14ad6b368"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:43:15 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:15 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:15 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:15 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] Creating event network-vif-plugged:c29e56c1-1810-4b73-bcb9-fcf14ad6b368 for instance c5f59b0b-3deb-48c7-9695-5727fa720407 on user May 01 22:43:15 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-053e0792-56b8-45ae-a95f-5fabe432129a req-15732369-8b27-4ed3-8370-4501ffb47de4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030484 May 01 22:43:15 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 116/352] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:19 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:43:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f154e49f-b38b-46b6-b5c8-7e103eea0b70 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 200 len: 1488 microversion: 2.1 time: 0.551696 May 01 22:43:19 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:43:18 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 1488 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] [instance: 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:43:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] HTTP exception thrown: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Request method failure captured: May 01 22:43:36 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 HTTP/1.1 May 01 22:43:36 user devstack@n-api.service[61365]: Accept: application/json May 01 22:43:36 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:43:36 user devstack@n-api.service[61365]: Connection: close May 01 22:43:36 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:43:36 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:43:36 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:43:36 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:43:36 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:43:36 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD5e49O8x7Lea9d9ouhzNZ8tbbjzzDE8YIb0ENeJAlWjTNnZj_X2jcKe5jZinK-2x_lO2G-tJDt7bH9mHfxW6wvzEpIxqWaUUSjiC88i78MZsHucu2jSwJ9pFN52qaheJB-vf95k3xCvdvt4c1lsQrHJVnjln6r47e3h4aFlBAPgRwc May 01 22:43:36 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:43:36 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:43:36 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:43:36 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:43:36 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:43:36 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:43:36 user devstack@n-api.service[61365]: X-Project-Id: 751cec193a3945c785b177e032cfc758 May 01 22:43:36 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:43:36 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:43:36 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:43:36 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/751cec193a3945c785b177e032cfc758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/751cec193a3945c785b177e032cfc758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:43:36 user devstack@n-api.service[61365]: X-Tenant: tempest-ServersNegativeTestJSON-1727673754 May 01 22:43:36 user devstack@n-api.service[61365]: X-Tenant-Id: 751cec193a3945c785b177e032cfc758 May 01 22:43:36 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1727673754 May 01 22:43:36 user devstack@n-api.service[61365]: X-User: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:43:36 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:43:36 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:43:36 user devstack@n-api.service[61365]: X-User-Id: 925c76f9d5114b489c630b78ff0b763f May 01 22:43:36 user devstack@n-api.service[61365]: X-User-Name: tempest-ServersNegativeTestJSON-1727673754-project-member May 01 22:43:36 user devstack@n-api.service[61365]: method: > May 01 22:43:36 user devstack@n-api.service[61365]: exception: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. May 01 22:43:36 user devstack@n-api.service[61365]: action_args: {'id': '7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02'} May 01 22:43:36 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. May 01 22:43:36 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:43:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] Returning 404 to user: Instance 7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:43:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-802e1879-3d68-4aa7-bced-8ac748525901 tempest-ServersNegativeTestJSON-1727673754 tempest-ServersNegativeTestJSON-1727673754-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02" status: 404 len: 111 microversion: 2.1 time: 0.041186 May 01 22:43:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 121/354] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:43:36 2023] GET /compute/v2.1/servers/7bc16b51-aa16-40a5-ac8d-fb51c1d6ef02 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:43:41 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:41 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:41 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-15129516-6434-4e57-8505-9d08f5c6cac0 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Action: 'create', calling method: .version_select at 0x7fc7047b09d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-608028097", "metadata": {"Type": "work"}}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:43:41 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-15129516-6434-4e57-8505-9d08f5c6cac0 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.483387 May 01 22:43:41 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 117/355] 10.0.0.210 () {64 vars in 1233 bytes} [Mon May 1 22:43:41 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 486 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) May 01 22:43:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5c60f8f2-9752-43a8-ac70-7bc2f9971f2e tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Calling method '.version_select at 0x7fc7047e23b0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=14 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:43:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5c60f8f2-9752-43a8-ac70-7bc2f9971f2e tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830" status: 200 len: 349 microversion: 2.1 time: 0.060307 May 01 22:43:41 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 118/356] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:43:41 2023] GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830 => generated 349 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:42 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-15959fad-a33b-4bab-9557-91656591c987 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Calling method '.version_select at 0x7fc70459ee60>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-15959fad-a33b-4bab-9557-91656591c987 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830" status: 200 len: 349 microversion: 2.1 time: 0.061989 May 01 22:43:42 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 122/357] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:43:42 2023] GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830 => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:43:42 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-6d91865f-0bfa-4228-876c-236e6a10172f tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Calling method '.version_select at 0x7fc7046383a0>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-6d91865f-0bfa-4228-876c-236e6a10172f tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830" status: 202 len: 0 microversion: 2.1 time: 0.111466 May 01 22:43:43 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 118/358] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:43:42 2023] DELETE /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:43:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-29a317b0-be2a-4415-a37c-d3becd03db07 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Calling method '.version_select at 0x7fc704630940>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:43:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-29a317b0-be2a-4415-a37c-d3becd03db07 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] HTTP exception thrown: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. May 01 22:43:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-29a317b0-be2a-4415-a37c-d3becd03db07 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Request method failure captured: May 01 22:43:43 user devstack@n-api.service[61366]: request: GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830 HTTP/1.1 May 01 22:43:43 user devstack@n-api.service[61366]: Accept: application/json May 01 22:43:43 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:43:43 user devstack@n-api.service[61366]: Connection: close May 01 22:43:43 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:43:43 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:43:43 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:43:43 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:43:43 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:43:43 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUECdHWUH_f5VlWlLSoTBpUvjzbzNpr-VyA6DmWVmTt3NR2j4j_Hfd7jwmdE_ZDd4j9idnOwDchfG1SgQ7pYAuYDBcORCiFJ8QQp9Jo9oPtv5tyy9cMh4s52WPTuzcbiMJiRK7kg4_PU1KPodez0Lf1Km83uT9immtTyLuRaDoNnSM68 May 01 22:43:43 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:43:43 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:43:43 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:43:43 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:43:43 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:43:43 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:43:43 user devstack@n-api.service[61366]: X-Project-Id: 78400571aec34b408062399020950d4b May 01 22:43:43 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesGetTestJSON-1991033248 May 01 22:43:43 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:43:43 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:43:43 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78400571aec34b408062399020950d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/78400571aec34b408062399020950d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78400571aec34b408062399020950d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:43:43 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesGetTestJSON-1991033248 May 01 22:43:43 user devstack@n-api.service[61366]: X-Tenant-Id: 78400571aec34b408062399020950d4b May 01 22:43:43 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesGetTestJSON-1991033248 May 01 22:43:43 user devstack@n-api.service[61366]: X-User: tempest-VolumesGetTestJSON-1991033248-project-member May 01 22:43:43 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:43:43 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:43:43 user devstack@n-api.service[61366]: X-User-Id: 11f88f634bc44c7a9e827b5e853bdb76 May 01 22:43:43 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesGetTestJSON-1991033248-project-member May 01 22:43:43 user devstack@n-api.service[61366]: method: May 01 22:43:43 user devstack@n-api.service[61366]: exception: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. May 01 22:43:43 user devstack@n-api.service[61366]: action_args: {'id': 'd474a0d4-4cb5-4a65-b592-ffe31a72b830'} May 01 22:43:43 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. (HTTP 404) (Request-ID: req-074cc948-2fff-433b-95f8-5f3d770a522b) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. May 01 22:43:43 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:43:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-29a317b0-be2a-4415-a37c-d3becd03db07 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] Returning 404 to user: Volume d474a0d4-4cb5-4a65-b592-ffe31a72b830 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:43:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-29a317b0-be2a-4415-a37c-d3becd03db07 tempest-VolumesGetTestJSON-1991033248 tempest-VolumesGetTestJSON-1991033248-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830" status: 404 len: 109 microversion: 2.1 time: 0.038414 May 01 22:43:43 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1322 bytes} [Mon May 1 22:43:43 2023] GET /compute/v2.1/os-volumes/d474a0d4-4cb5-4a65-b592-ffe31a72b830 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] [instance: c5f59b0b-3deb-48c7-9695-5727fa720407] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:44:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] HTTP exception thrown: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Request method failure captured: May 01 22:44:04 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 HTTP/1.1 May 01 22:44:04 user devstack@n-api.service[61365]: Accept: application/json May 01 22:44:04 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:44:04 user devstack@n-api.service[61365]: Connection: close May 01 22:44:04 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:44:04 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:44:04 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:44:04 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:44:04 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:44:04 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUEAOD9Gv9y7XStNLBWbu07CUAcCeKBg4tGT-wOJXMPfcEBtcOet32ADTathdNSXSeSTGxKKFu2Kbk_Jmz2jSQN24dPVLAE9aZMXRJe9fvqe8qscuyje6b-7waW1SaYFVLfW7HUAf5ATdv5d5PCTeECwM6HCgOO5RA9h7af8wmqB_SsQ May 01 22:44:04 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:44:04 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:44:04 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:44:04 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:44:04 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:44:04 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:44:04 user devstack@n-api.service[61365]: X-Project-Id: 33d82b559d33412cb017588ae66ea7f0 May 01 22:44:04 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesActionsTest-1076112184 May 01 22:44:04 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:44:04 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:44:04 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33d82b559d33412cb017588ae66ea7f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33d82b559d33412cb017588ae66ea7f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33d82b559d33412cb017588ae66ea7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:44:04 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesActionsTest-1076112184 May 01 22:44:04 user devstack@n-api.service[61365]: X-Tenant-Id: 33d82b559d33412cb017588ae66ea7f0 May 01 22:44:04 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesActionsTest-1076112184 May 01 22:44:04 user devstack@n-api.service[61365]: X-User: tempest-VolumesActionsTest-1076112184-project-member May 01 22:44:04 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:44:04 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:44:04 user devstack@n-api.service[61365]: X-User-Id: 272675f44644423aa2e33baf43ed76de May 01 22:44:04 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesActionsTest-1076112184-project-member May 01 22:44:04 user devstack@n-api.service[61365]: method: > May 01 22:44:04 user devstack@n-api.service[61365]: exception: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. May 01 22:44:04 user devstack@n-api.service[61365]: action_args: {'id': 'c5f59b0b-3deb-48c7-9695-5727fa720407'} May 01 22:44:04 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. May 01 22:44:04 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:44:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] Returning 404 to user: Instance c5f59b0b-3deb-48c7-9695-5727fa720407 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:44:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a9a8cf55-aeda-4b63-b8e3-93070887724c tempest-VolumesActionsTest-1076112184 tempest-VolumesActionsTest-1076112184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407" status: 404 len: 111 microversion: 2.1 time: 0.035274 May 01 22:44:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 123/360] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:44:04 2023] GET /compute/v2.1/servers/c5f59b0b-3deb-48c7-9695-5727fa720407 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:44:19 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:44:19 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-516a21ef-7bd8-463c-8800-ced4be6ac9b8 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1" status: 200 len: 1505 microversion: 2.1 time: 0.291293 May 01 22:44:19 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 119/361] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:44:19 2023] GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:45:22 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:45:22 user devstack@n-api.service[61366]: Mon May 1 22:45:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc (ip 10.0.0.210) !!! May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:22 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:45:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2f376484-8e68-44dc-b089-07d2c56894a4 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 204 len: 0 microversion: 2.1 time: 0.131474 May 01 22:45:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:45:22 2023] DELETE /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:45:23 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:45:23 user devstack@n-api.service[61365]: Mon May 1 22:45:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc (ip 10.0.0.210) !!! May 01 22:45:23 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:45:23 user devstack@n-api.service[61365]: Mon May 1 22:45:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc (ip 10.0.0.210) !!! May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:45:23 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:45:23 user devstack@n-api.service[61364]: Mon May 1 22:45:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:23 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:23 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] Creating event network-vif-unplugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:45:23 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-a7bb5073-8f1e-46db-b8be-f83479a9d7ea req-e667002b-2d2a-4d72-aa38-b13934ee85f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037069 May 01 22:45:23 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 120/363] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:45:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:45:23 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:45:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fc2f33ae-6556-4127-bfcc-55d64a1444fb tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 200 len: 1494 microversion: 2.1 time: 0.437239 May 01 22:45:23 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 124/364] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:45:22 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 1494 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:45:24 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-deleted", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:45:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] Creating event network-vif-deleted:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:45:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-f9bc2623-f6ed-4e09-b84f-9e0ff60ff606 req-e383c0b1-8792-4bab-b879-effafd14fecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 May 01 22:45:24 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 121/365] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:45:25 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3682d5e0-02a8-4b92-8c8d-81f86414dbbc", "name": "network-vif-plugged", "status": "completed", "tag": "42b02347-1a4e-4fc7-b984-f84a9114434f"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:45:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:45:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:45:25 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:45:25 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] Creating event network-vif-plugged:42b02347-1a4e-4fc7-b984-f84a9114434f for instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc on user May 01 22:45:25 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-00d1ec5a-bcb0-45cd-a06e-c7b275bd79b6 req-79353662-5d40-4724-bfcf-c89b0a5450c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031840 May 01 22:45:25 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 121/366] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 3682d5e0-02a8-4b92-8c8d-81f86414dbbc] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] HTTP exception thrown: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Request method failure captured: May 01 22:46:13 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc HTTP/1.1 May 01 22:46:13 user devstack@n-api.service[61365]: Accept: application/json May 01 22:46:13 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:46:13 user devstack@n-api.service[61365]: Connection: close May 01 22:46:13 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:46:13 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:46:13 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:46:13 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:46:13 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:46:13 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUD_kjBzEyWBxFpu0aVIs36M0WwHe7lmldFvd7QDZgng4Mo8mwKvqJo-FYRxVFx-vCkTiu_TsV3_j6VzKIj1w1BUEGUDwUqPe6DGfX58EYF9Fh1LWweZE_M8IsKAeRE28rqOb8Vcxzcf_Nc8LNgEUYZwaxHF8bXKBvn5dBbtXS8i9FVs May 01 22:46:13 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:46:13 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:46:13 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:46:13 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:46:13 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:46:13 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:46:13 user devstack@n-api.service[61365]: X-Project-Id: 3b813d8c60794ed481b464a012aeb601 May 01 22:46:13 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:46:13 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:46:13 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:46:13 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:46:13 user devstack@n-api.service[61365]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:46:13 user devstack@n-api.service[61365]: X-Tenant-Id: 3b813d8c60794ed481b464a012aeb601 May 01 22:46:13 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:46:13 user devstack@n-api.service[61365]: X-User: tempest-ServerRescueNegativeTestJSON-1558296451-project-member May 01 22:46:13 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:46:13 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:46:13 user devstack@n-api.service[61365]: X-User-Id: 51b0b49ccd7f4a8bae43dab2f309403e May 01 22:46:13 user devstack@n-api.service[61365]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558296451-project-member May 01 22:46:13 user devstack@n-api.service[61365]: method: > May 01 22:46:13 user devstack@n-api.service[61365]: exception: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. May 01 22:46:13 user devstack@n-api.service[61365]: action_args: {'id': '3682d5e0-02a8-4b92-8c8d-81f86414dbbc'} May 01 22:46:13 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. May 01 22:46:13 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:46:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Returning 404 to user: Instance 3682d5e0-02a8-4b92-8c8d-81f86414dbbc could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:46:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-95ef61cd-55fd-4e23-88c8-01d6a0356e61 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc" status: 404 len: 111 microversion: 2.1 time: 0.207280 May 01 22:46:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 125/367] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:46:13 2023] GET /compute/v2.1/servers/3682d5e0-02a8-4b92-8c8d-81f86414dbbc => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:46:13 user devstack@n-api.service[61366]: Mon May 1 22:46:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 (ip 10.0.0.210) !!! May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:13 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:46:13 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-321dd9bb-fa10-4f8a-a3ad-77b0af519373 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1" status: 204 len: 0 microversion: 2.1 time: 0.137273 May 01 22:46:13 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:46:13 2023] DELETE /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:13 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:14 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:46:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] Creating event network-vif-unplugged:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:46:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-4a84d6b6-4cf7-48c0-adc1-84dbf7d1b472 req-8e5ffe44-c1fe-43b2-8245-3dd5f7c4ad9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039529 May 01 22:46:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 126/369] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:46:14 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b0b49ccd7f4a8bae43dab2f309403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b813d8c60794ed481b464a012aeb601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:46:14 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-2f6c97c8-97f5-45c3-9bcc-0e4453e4705d tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1" status: 200 len: 1511 microversion: 2.1 time: 0.704871 May 01 22:46:14 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:46:13 2023] GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 => generated 1511 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:46:15 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "name": "network-vif-deleted", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:46:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:15 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] Creating event network-vif-deleted:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:46:15 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-02646cf9-afe8-4f45-a185-5ee28c9370fe req-54a928d0-f271-4ffc-872c-e0ec984027d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094836 May 01 22:46:15 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 123/371] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:46:16 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d3e44f-f748-473b-ad7c-94b8ec758ab1", "name": "network-vif-plugged", "status": "completed", "tag": "9a9039c1-a3eb-4d60-9bbb-ebb01543baff"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:46:16 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:46:16 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:46:16 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:46:16 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] Creating event network-vif-plugged:9a9039c1-a3eb-4d60-9bbb-ebb01543baff for instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 on user May 01 22:46:16 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-161a6151-7ff0-484b-a09f-6c2211b99cd3 req-56c0813d-bdea-4543-b00d-7785d73e7857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029698 May 01 22:46:16 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 127/372] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] [instance: 81d3e44f-f748-473b-ad7c-94b8ec758ab1] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:04 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] HTTP exception thrown: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Request method failure captured: May 01 22:47:04 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 HTTP/1.1 May 01 22:47:04 user devstack@n-api.service[61364]: Accept: application/json May 01 22:47:04 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:47:04 user devstack@n-api.service[61364]: Connection: close May 01 22:47:04 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:47:04 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:47:04 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:47:04 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:47:04 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:47:04 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUD_kjBzEyWBxFpu0aVIs36M0WwHe7lmldFvd7QDZgng4Mo8mwKvqJo-FYRxVFx-vCkTiu_TsV3_j6VzKIj1w1BUEGUDwUqPe6DGfX58EYF9Fh1LWweZE_M8IsKAeRE28rqOb8Vcxzcf_Nc8LNgEUYZwaxHF8bXKBvn5dBbtXS8i9FVs May 01 22:47:04 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:47:04 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:47:04 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:47:04 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:47:04 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:47:04 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:47:04 user devstack@n-api.service[61364]: X-Project-Id: 3b813d8c60794ed481b464a012aeb601 May 01 22:47:04 user devstack@n-api.service[61364]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:47:04 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:47:04 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:47:04 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b813d8c60794ed481b464a012aeb601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:47:04 user devstack@n-api.service[61364]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:47:04 user devstack@n-api.service[61364]: X-Tenant-Id: 3b813d8c60794ed481b464a012aeb601 May 01 22:47:04 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558296451 May 01 22:47:04 user devstack@n-api.service[61364]: X-User: tempest-ServerRescueNegativeTestJSON-1558296451-project-member May 01 22:47:04 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:47:04 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:47:04 user devstack@n-api.service[61364]: X-User-Id: 51b0b49ccd7f4a8bae43dab2f309403e May 01 22:47:04 user devstack@n-api.service[61364]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558296451-project-member May 01 22:47:04 user devstack@n-api.service[61364]: method: > May 01 22:47:04 user devstack@n-api.service[61364]: exception: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. May 01 22:47:04 user devstack@n-api.service[61364]: action_args: {'id': '81d3e44f-f748-473b-ad7c-94b8ec758ab1'} May 01 22:47:04 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. May 01 22:47:04 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:47:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] Returning 404 to user: Instance 81d3e44f-f748-473b-ad7c-94b8ec758ab1 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:47:04 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-e9a264ba-49e3-44d2-b98e-7c2912e1c9d9 tempest-ServerRescueNegativeTestJSON-1558296451 tempest-ServerRescueNegativeTestJSON-1558296451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1" status: 404 len: 111 microversion: 2.1 time: 0.034920 May 01 22:47:04 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 123/373] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:47:04 2023] GET /compute/v2.1/servers/81d3e44f-f748-473b-ad7c-94b8ec758ab1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:47:15 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:15 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:15 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5b7c6b48-8cdd-4953-bab4-99dd22895f71 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Action: 'create', calling method: .version_select at 0x7fc704630f70>, body: {"keypair": {"name": "tempest-keypair-989263772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPra2AY6DbL67F5dUXKxxuvL5IZXhal1lpVqp0vD1mdVtAEn1NUsmNKsOoug1Ubbqz3/JyJX/ghJKeBrUBQSuv34I5MMbIgVEo4/ufjtRfrhNYlCTSdutogzg6PKTEPNvw=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:47:15 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-5b7c6b48-8cdd-4953-bab4-99dd22895f71 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for project 13db123c9edc40238d0a7c541070eb08. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:47:15 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-5b7c6b48-8cdd-4953-bab4-99dd22895f71 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for user 155eac609630422fbe0511f3443263c3 and project 13db123c9edc40238d0a7c541070eb08. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:47:15 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5b7c6b48-8cdd-4953-bab4-99dd22895f71 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.183900 May 01 22:47:15 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 124/374] 10.0.0.210 () {66 vars in 1277 bytes} [Mon May 1 22:47:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-628248575", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a82c78dc-bfe5-42da-b560-2d80d3af0e0c"}], "security_groups": [{"name": "tempest-securitygroup--1623079819"}], "key_name": "tempest-keypair-989263772", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] validate_networks() for [('a82c78dc-bfe5-42da-b560-2d80d3af0e0c', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:17 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:18 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for project 13db123c9edc40238d0a7c541070eb08. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:47:18 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for user 155eac609630422fbe0511f3443263c3 and project 13db123c9edc40238d0a7c541070eb08. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:47:18 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:47:18 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:47:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-52fe72f4-2e1e-4a33-8be7-a6005cc059d6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.690945 May 01 22:47:18 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 128/375] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:47:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:47:18 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:47:18 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-bd295bb1-88d8-477d-b60b-2d04af74bdb7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 200 len: 1274 microversion: 2.20 time: 0.085774 May 01 22:47:18 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 124/376] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:47:18 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:47:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:47:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] Creating event network-changed:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:47:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-8ac2c351-1217-4ea2-ab98-832e74d64f88 req-a529e7f6-e14d-4e8e-94d9-db55dd18792b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038065 May 01 22:47:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 125/377] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:47:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:47:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "name": "network-vif-plugged", "status": "completed", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:47:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] Creating event network-vif-plugged:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:47:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d8c2401d-8d0b-4f86-877b-ec931277fb45 req-fb534657-0a22-4c34-bdf9-5779d1775d05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 May 01 22:47:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 129/378] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:47:24 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "name": "network-vif-plugged", "status": "completed", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:47:24 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:47:24 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:47:24 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:47:24 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] Creating event network-vif-plugged:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:47:24 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-6ee2b076-d9a1-4587-b534-263db1b52287 req-fa13e1f0-a09e-4919-bb8f-7bbfa710215e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 May 01 22:47:24 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 125/379] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:48:08 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:48:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0e6aabc5-8114-4b4a-bc94-80c72392965b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 200 len: 1587 microversion: 2.20 time: 0.358597 May 01 22:48:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 126/380] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:48:08 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 1587 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dbe4e725-2f1d-4f41-ba92-a839509444cb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.557709 May 01 22:49:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 130/381] 10.0.0.210 () {64 vars in 1393 bytes} [Mon May 1 22:49:08 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521/os-interface => generated 283 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:10 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0b2b0e94-1f2c-41ee-b600-a7808edb7a03 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521/ips" status: 200 len: 111 microversion: 2.20 time: 0.040286 May 01 22:49:10 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 127/382] 10.0.0.210 () {64 vars in 1366 bytes} [Mon May 1 22:49:10 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521/ips => generated 111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 01 22:49:10 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] Creating event network-changed:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:49:10 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-c4b7286d-dcf7-41b7-a31b-313effa7ee75 req-80c97917-cb5b-4088-afe3-13fd4b65889b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110172 May 01 22:49:10 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 126/383] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:12 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:49:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-148fa4d7-d130-4eef-9306-1baaa98a068b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 204 len: 0 microversion: 2.20 time: 0.111039 May 01 22:49:12 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 131/384] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:49:12 2023] DELETE /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:12 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "name": "network-vif-unplugged", "status": "completed", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:49:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:12 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] Creating event network-vif-unplugged:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:49:12 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-807338ee-9517-4c57-8fe7-e733fdadd40b req-1e7ca937-5bce-4b92-acd6-9ada0bc610df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030826 May 01 22:49:12 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:49:12 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:49:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c3cf7feb-1958-41cf-bab3-b25292075204 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 200 len: 1712 microversion: 2.20 time: 0.292989 May 01 22:49:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:49:12 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 1712 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:49:14 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "name": "network-vif-plugged", "status": "completed", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}, {"server_uuid": "904ec297-0340-499a-a49d-88a2dfa7d521", "name": "network-vif-deleted", "tag": "dbecbda7-80dc-4310-8e42-e6091f85cd0b"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:49:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:49:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:49:14 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:49:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Creating event network-vif-plugged:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:49:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] Creating event network-vif-deleted:dbecbda7-80dc-4310-8e42-e6091f85cd0b for instance 904ec297-0340-499a-a49d-88a2dfa7d521 on user May 01 22:49:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-8e588af5-aed4-471d-9027-6854ec82ad7a req-99502805-d232-46b8-8626-e07df6cd0835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028168 May 01 22:49:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 132/387] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:02 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:50:02 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 HTTP/1.1 May 01 22:50:02 user devstack@n-api.service[61364]: Accept: application/json May 01 22:50:02 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:50:02 user devstack@n-api.service[61364]: Connection: close May 01 22:50:02 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:50:02 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:50:02 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:50:02 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:50:02 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:50:02 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:50:02 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:50:02 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:50:02 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:50:02 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:50:02 user devstack@n-api.service[61364]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:50:02 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:50:02 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:50:02 user devstack@n-api.service[61364]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:50:02 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:50:02 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:50:02 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:50:02 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:50:02 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:50:02 user devstack@n-api.service[61364]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:50:02 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:50:02 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:50:02 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:50:02 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:50:02 user devstack@n-api.service[61364]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:50:02 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:50:02 user devstack@n-api.service[61364]: method: > May 01 22:50:02 user devstack@n-api.service[61364]: exception: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:50:02 user devstack@n-api.service[61364]: action_args: {'id': '904ec297-0340-499a-a49d-88a2dfa7d521'} May 01 22:50:02 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:50:02 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:50:02 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:50:02 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-5103f8df-c4ca-4c4e-9573-b4bc0fd19ad6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 404 len: 111 microversion: 2.20 time: 0.037849 May 01 22:50:02 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 128/388] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:50:02 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:50:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f6723a25-fbff-45de-bca5-3f50154ac186 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '.version_select at 0x7fc704632950>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:50:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f6723a25-fbff-45de-bca5-3f50154ac186 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989263772" status: 204 len: 0 microversion: 2.20 time: 0.028367 May 01 22:50:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 129/389] 10.0.0.210 () {64 vars in 1336 bytes} [Mon May 1 22:50:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989263772 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:50:03 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:50:03 user devstack@n-api.service[61365]: Mon May 1 22:50:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! May 01 22:50:03 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:50:03 user devstack@n-api.service[61365]: Mon May 1 22:50:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! May 01 22:50:03 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:03 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1d29e660-c30b-4a6f-850a-8506905cc7a7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Action: 'create', calling method: .version_select at 0x7fc704423010>, body: {"keypair": {"name": "tempest-keypair-1057238106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPv4y9uSIjwQhsXzd1Z89A9kc6H7JG+5UdxAPWeXwKrT/R7FYlhsSreM3qKabg6grvZGak9yDTNJprJHEosWyug702YsLtvG/kiTj1GuHXzs79iE9p3MzUaMB2Idyzy5ZA=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:50:03 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-1d29e660-c30b-4a6f-850a-8506905cc7a7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for project 13db123c9edc40238d0a7c541070eb08. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:50:03 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-1d29e660-c30b-4a6f-850a-8506905cc7a7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for user 155eac609630422fbe0511f3443263c3 and project 13db123c9edc40238d0a7c541070eb08. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:50:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1d29e660-c30b-4a6f-850a-8506905cc7a7 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.063044 May 01 22:50:03 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 133/390] 10.0.0.210 () {66 vars in 1277 bytes} [Mon May 1 22:50:03 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 01 22:50:04 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1567306941", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a82c78dc-bfe5-42da-b560-2d80d3af0e0c"}], "security_groups": [{"name": "tempest-securitygroup--467165517"}], "key_name": "tempest-keypair-1057238106", "user_data": "}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] validate_networks() for [('a82c78dc-bfe5-42da-b560-2d80d3af0e0c', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for project 13db123c9edc40238d0a7c541070eb08. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Getting quotas for user 155eac609630422fbe0511f3443263c3 and project 13db123c9edc40238d0a7c541070eb08. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:50:05 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:50:05 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-2548ba57-3ea0-4909-9cc2-3b9c8fa342e3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.712872 May 01 22:50:05 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 129/391] 10.0.0.210 () {66 vars in 1265 bytes} [Mon May 1 22:50:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 01 22:50:05 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:50:05 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:50:05 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:05 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:05 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-cfb49f8e-21c9-4b97-8e5a-fa6d534695c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 200 len: 1276 microversion: 2.20 time: 0.068244 May 01 22:50:05 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 130/392] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:50:05 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 1276 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 01 22:50:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:50:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] Creating event network-changed:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:50:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-8d588907-be0c-4d9f-893b-0f0d535a1b5d req-12987851-f37a-433e-ae1c-f7999a13d0d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030416 May 01 22:50:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 134/393] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:50:10 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "name": "network-vif-plugged", "status": "completed", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:50:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:10 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:10 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] Creating event network-vif-plugged:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:50:10 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-bcf8075c-95e3-44bf-bbfe-d007733aa53d req-24c2dbb2-d7ed-4eda-ac3c-47adc23f480d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028272 May 01 22:50:10 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:50:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "name": "network-vif-plugged", "status": "completed", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:50:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:12 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] Creating event network-vif-plugged:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:50:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-dfac878d-ee6e-4ea8-bfde-9183c61c6760 req-afc094f6-8212-420e-bc0c-edea08873247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047983 May 01 22:50:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:50:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:50:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:50:56 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:56 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:56 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:50:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-56221eff-ca5c-42f1-a899-9e20515809e1 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 200 len: 1587 microversion: 2.20 time: 0.301586 May 01 22:50:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 135/396] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:50:55 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 1587 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:56 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:51:56 user devstack@n-api.service[61364]: Mon May 1 22:51:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe/os-interface (ip 10.0.0.210) !!! May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-c15d15a1-cd61-4961-a9c9-b144b54914a6 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.333356 May 01 22:51:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 131/397] 10.0.0.210 () {64 vars in 1393 bytes} [Mon May 1 22:51:56 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe/os-interface => generated 282 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:57 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:51:57 user devstack@n-api.service[61366]: Mon May 1 22:51:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] Creating event network-changed:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:51:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-58ad9e8e-6e73-48a9-8bf9-0a29355a22a3 req-0f82bfcb-3ebb-48da-90b7-edec7d64ec84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041881 May 01 22:51:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 132/398] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:51:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-8789036d-b659-475a-a468-5d7c1f1004fb tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe/ips" status: 200 len: 110 microversion: 2.20 time: 0.039159 May 01 22:51:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 136/399] 10.0.0.210 () {64 vars in 1366 bytes} [Mon May 1 22:51:57 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:58 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:51:58 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-9217b099-1b3d-4e82-9f46-93becd8bf2c4 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 204 len: 0 microversion: 2.20 time: 0.122980 May 01 22:51:58 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 132/400] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:51:58 2023] DELETE /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "name": "network-vif-unplugged", "status": "completed", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:51:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:51:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:51:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:51:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] Creating event network-vif-unplugged:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:51:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-fb8acdfb-9107-4644-b403-2a9df2dea11d req-605b8fb3-8990-4c94-bba6-93ffcb8a59fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133647 May 01 22:51:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 137/401] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:51:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:51:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:51:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:51:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '155eac609630422fbe0511f3443263c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13db123c9edc40238d0a7c541070eb08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:51:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f968871d-7db8-4106-8f33-7fb1837bc15b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 200 len: 1712 microversion: 2.20 time: 0.572184 May 01 22:51:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 133/402] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:51:58 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 1712 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 01 22:52:01 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "name": "network-vif-plugged", "status": "completed", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}, {"server_uuid": "4f150446-2b7d-4591-9e34-7b26c55a47fe", "name": "network-vif-deleted", "tag": "c84f9c8a-1777-4d47-8a06-4d7b7e8f6588"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:52:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:01 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Creating event network-vif-plugged:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:52:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] Creating event network-vif-deleted:c84f9c8a-1777-4d47-8a06-4d7b7e8f6588 for instance 4f150446-2b7d-4591-9e34-7b26c55a47fe on user May 01 22:52:01 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-a40d51e6-6bb5-48c9-964f-bf05cb2c125a req-ab90cc46-5f13-4d6e-ab00-e20aff8fb60d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030865 May 01 22:52:01 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 133/403] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:52:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:52:49 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe HTTP/1.1 May 01 22:52:49 user devstack@n-api.service[61365]: Accept: application/json May 01 22:52:49 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:52:49 user devstack@n-api.service[61365]: Connection: close May 01 22:52:49 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:52:49 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:52:49 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:52:49 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:52:49 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:52:49 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:52:49 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:52:49 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:52:49 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:52:49 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:52:49 user devstack@n-api.service[61365]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:52:49 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:52:49 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:52:49 user devstack@n-api.service[61365]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:49 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:49 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:52:49 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:52:49 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:52:49 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:49 user devstack@n-api.service[61365]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:49 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:49 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:49 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:52:49 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:52:49 user devstack@n-api.service[61365]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:52:49 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:49 user devstack@n-api.service[61365]: method: > May 01 22:52:49 user devstack@n-api.service[61365]: exception: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:49 user devstack@n-api.service[61365]: action_args: {'id': '4f150446-2b7d-4591-9e34-7b26c55a47fe'} May 01 22:52:49 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:49 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:52:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9b692992-cd79-4483-80fc-bb8d2869d24a tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 404 len: 111 microversion: 2.20 time: 0.084650 May 01 22:52:49 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 138/404] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:52:49 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:52:49 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:49 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:49 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:52:49 user devstack@n-api.service[61366]: Mon May 1 22:52:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1057238106 (ip 10.0.0.210) !!! May 01 22:52:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-505f88aa-766f-438e-84ef-6e8e76e4eba3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '.version_select at 0x7fc704630c10>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-505f88aa-766f-438e-84ef-6e8e76e4eba3 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057238106" status: 204 len: 0 microversion: 2.20 time: 0.040423 May 01 22:52:49 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 134/405] 10.0.0.210 () {64 vars in 1339 bytes} [Mon May 1 22:52:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057238106 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 01 22:52:50 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:52:50 user devstack@n-api.service[61364]: Mon May 1 22:52:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe (ip 10.0.0.210) !!! May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:52:50 user devstack@n-api.service[61364]: request: DELETE /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe HTTP/1.1 May 01 22:52:50 user devstack@n-api.service[61364]: Accept: application/json May 01 22:52:50 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:52:50 user devstack@n-api.service[61364]: Connection: close May 01 22:52:50 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:52:50 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:52:50 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:52:50 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:52:50 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:52:50 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:52:50 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:52:50 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:52:50 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:52:50 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:52:50 user devstack@n-api.service[61364]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:52:50 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:52:50 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61364]: method: > May 01 22:52:50 user devstack@n-api.service[61364]: exception: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: action_args: {'id': '4f150446-2b7d-4591-9e34-7b26c55a47fe'} May 01 22:52:50 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:52:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-9aa609af-1a45-4c61-95b5-06d35f64cb00 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 404 len: 111 microversion: 2.20 time: 0.041866 May 01 22:52:50 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 134/406] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:52:50 2023] DELETE /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 4f150446-2b7d-4591-9e34-7b26c55a47fe] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:52:50 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe HTTP/1.1 May 01 22:52:50 user devstack@n-api.service[61365]: Accept: application/json May 01 22:52:50 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:52:50 user devstack@n-api.service[61365]: Connection: close May 01 22:52:50 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:52:50 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:52:50 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:52:50 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:52:50 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:52:50 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:52:50 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:52:50 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:52:50 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:52:50 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:52:50 user devstack@n-api.service[61365]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:52:50 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61365]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:52:50 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:52:50 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:52:50 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61365]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61365]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:52:50 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61365]: method: > May 01 22:52:50 user devstack@n-api.service[61365]: exception: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61365]: action_args: {'id': '4f150446-2b7d-4591-9e34-7b26c55a47fe'} May 01 22:52:50 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. May 01 22:52:50 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 4f150446-2b7d-4591-9e34-7b26c55a47fe could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:52:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-bd58fd48-5a70-4ff6-94e2-35cd2dc2d12f tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe" status: 404 len: 111 microversion: 2.20 time: 0.030146 May 01 22:52:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 139/407] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:52:50 2023] GET /compute/v2.1/servers/4f150446-2b7d-4591-9e34-7b26c55a47fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:52:50 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 HTTP/1.1 May 01 22:52:50 user devstack@n-api.service[61366]: Accept: application/json May 01 22:52:50 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 22:52:50 user devstack@n-api.service[61366]: Connection: close May 01 22:52:50 user devstack@n-api.service[61366]: Content-Length: 0 May 01 22:52:50 user devstack@n-api.service[61366]: Content-Type: application/json May 01 22:52:50 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 22:52:50 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 22:52:50 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 22:52:50 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:52:50 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 22:52:50 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 22:52:50 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 22:52:50 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 22:52:50 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:52:50 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61366]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61366]: X-Role: member,reader May 01 22:52:50 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 22:52:50 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:52:50 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61366]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61366]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:52:50 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61366]: method: > May 01 22:52:50 user devstack@n-api.service[61366]: exception: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61366]: action_args: {'id': '904ec297-0340-499a-a49d-88a2dfa7d521'} May 01 22:52:50 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:52:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e632db4e-8dac-4208-be60-5801abe0d6c5 tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 404 len: 111 microversion: 2.20 time: 0.026885 May 01 22:52:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 135/408] 10.0.0.210 () {64 vars in 1357 bytes} [Mon May 1 22:52:50 2023] DELETE /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] [instance: 904ec297-0340-499a-a49d-88a2dfa7d521] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:52:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] HTTP exception thrown: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Request method failure captured: May 01 22:52:50 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 HTTP/1.1 May 01 22:52:50 user devstack@n-api.service[61364]: Accept: application/json May 01 22:52:50 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:52:50 user devstack@n-api.service[61364]: Connection: close May 01 22:52:50 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:52:50 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:52:50 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:52:50 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:52:50 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:52:50 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUEFzfpG5OXgkmU8cYOn-uctNEdycnorW4DawhehlBwFH7YIl_8P-UY8pjLL5w5sbhIqWh2HXwNC57ahZD09DOQxzW_5pzkHZN4aaSAPuRoUndcqShwEAtuvunuENLEItqsx_7qbc8qAYTTHZEBRpD-J1_9h3Ld21fa5c4m8oQgIMI_s May 01 22:52:50 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:52:50 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:52:50 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:52:50 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:52:50 user devstack@n-api.service[61364]: X-Openstack-Nova-Api-Version: 2.20 May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:52:50 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:52:50 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13db123c9edc40238d0a7c541070eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant-Id: 13db123c9edc40238d0a7c541070eb08 May 01 22:52:50 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636466610 May 01 22:52:50 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Id: 155eac609630422fbe0511f3443263c3 May 01 22:52:50 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636466610-project-member May 01 22:52:50 user devstack@n-api.service[61364]: method: > May 01 22:52:50 user devstack@n-api.service[61364]: exception: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: action_args: {'id': '904ec297-0340-499a-a49d-88a2dfa7d521'} May 01 22:52:50 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. May 01 22:52:50 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:52:50 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] Returning 404 to user: Instance 904ec297-0340-499a-a49d-88a2dfa7d521 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:52:50 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-2da202cc-40ed-47db-a6c4-8a0d4a67d24b tempest-AttachVolumeShelveTestJSON-636466610 tempest-AttachVolumeShelveTestJSON-636466610-project-member] 10.0.0.210 "GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521" status: 404 len: 111 microversion: 2.20 time: 0.030461 May 01 22:52:50 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 135/409] 10.0.0.210 () {64 vars in 1354 bytes} [Mon May 1 22:52:50 2023] GET /compute/v2.1/servers/904ec297-0340-499a-a49d-88a2dfa7d521 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 01 22:53:00 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:00 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:00 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-2aca7d25-76e5-428c-82eb-0956c0535e4e tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: .version_select at 0x7fc70459ed40>, body: {"keypair": {"name": "tempest-keypair-1234927683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeu4BspQxsLGBSYnhWu6UfgLImEEGkIkiTBGFj23g6DZ0Q9/KclP6Z8dyobBSgSv56NnKGRb73RgCnHt/lhkkccCneq0x+FAnNwxUMUkA8AE2WLUKDqJ/d3kW8PQVRRVw=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:53:00 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2aca7d25-76e5-428c-82eb-0956c0535e4e tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:53:00 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2aca7d25-76e5-428c-82eb-0956c0535e4e tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:53:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2aca7d25-76e5-428c-82eb-0956c0535e4e tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159519 May 01 22:53:00 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 140/410] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:53:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1285831500", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d4380515-a8d0-4406-9cf8-d29e6b16bcea"}], "security_groups": [{"name": "tempest-securitygroup--262104233"}], "key_name": "tempest-keypair-1234927683", "user_data": "}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] validate_networks() for [('d4380515-a8d0-4406-9cf8-d29e6b16bcea', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:53:02 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:53:03 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ad25601c-5211-4bd0-9896-d9c0771eee8f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.917513 May 01 22:53:03 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 136/411] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:53:02 2023] POST /compute/v2.1/servers => generated 399 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:53:03 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-645ecc0c-ed11-4add-8cdf-04d66ef34649 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:53:03 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-645ecc0c-ed11-4add-8cdf-04d66ef34649 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:53:03 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:03 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:03 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-645ecc0c-ed11-4add-8cdf-04d66ef34649 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:53:03 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-645ecc0c-ed11-4add-8cdf-04d66ef34649 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 200 len: 1236 microversion: 2.1 time: 0.084309 May 01 22:53:03 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:53:03 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:53:05 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:53:05 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:05 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:05 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:05 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] Creating event network-changed:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:53:05 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-8bcd1028-6dc1-47c2-bccd-22e4ceab4e23 req-ab89f2ae-e475-4ec9-b447-b3f0356f59e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031362 May 01 22:53:05 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 141/413] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:53:07 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "name": "network-vif-plugged", "status": "completed", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:53:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] Creating event network-vif-plugged:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:53:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-aaec2e24-c89e-40b2-8e00-6f4e91650780 req-e99dc597-8564-4419-9c6a-de64b43c2422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039007 May 01 22:53:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 137/414] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:53:09 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "name": "network-vif-plugged", "status": "completed", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:53:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:09 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:09 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] Creating event network-vif-plugged:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:53:09 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-19973463-7ad7-49ae-93dd-f323ce44940f req-55e163d7-e804-4562-b1b8-8130932c21e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 May 01 22:53:09 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 137/415] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:53:53 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:53:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3115cb14-465a-4eb9-af5d-2061e92f2184 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 200 len: 1546 microversion: 2.1 time: 0.212981 May 01 22:53:53 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 142/416] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:53:53 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6f2abadf-fc19-41ba-bbe9-78ed658769b7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.657759 May 01 22:54:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 138/417] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:54:53 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5/os-interface => generated 283 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:54 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] Creating event network-changed:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:54:54 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-0307b891-ceaa-4f80-955f-b610b4fd5c44 req-0dfb2af6-7c42-4925-a202-8ddbdb647eed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043609 May 01 22:54:54 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 138/418] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-aa16f5fc-c708-4316-8689-01646434c6ff tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5/ips" status: 200 len: 109 microversion: 2.1 time: 0.042575 May 01 22:54:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 143/419] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:54:54 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:56 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:54:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-26757c41-b770-4faa-a7cb-5344a370b895 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 204 len: 0 microversion: 2.1 time: 0.117393 May 01 22:54:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 139/420] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:54:56 2023] DELETE /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:56 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "name": "network-vif-unplugged", "status": "completed", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:54:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] Creating event network-vif-unplugged:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:54:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-80636d5d-2a86-4fca-b219-e1277ad18239 req-7ea5842f-5fe0-4bd1-aa8f-40108a96314c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086143 May 01 22:54:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 144/421] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:54:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:54:56 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:54:56 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-4ca313d2-cb90-4c5a-a6e5-545649b0a7a6 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 200 len: 1670 microversion: 2.1 time: 0.442914 May 01 22:54:56 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:54:56 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 1670 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:54:58 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "name": "network-vif-deleted", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:54:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:58 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] Creating event network-vif-deleted:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:54:58 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-7743ef5a-39a9-4d50-896f-9352bd596c72 req-2db25c7a-3751-4637-812f-ae075f0b6013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 May 01 22:54:58 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 140/423] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:54:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:54:58 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03523e9f-691c-4428-b696-ace95ced83e5", "name": "network-vif-plugged", "status": "completed", "tag": "18d775cf-a53e-4c8e-9a65-59fbd421f3a3"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:54:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:54:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:54:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:54:58 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] Creating event network-vif-plugged:18d775cf-a53e-4c8e-9a65-59fbd421f3a3 for instance 03523e9f-691c-4428-b696-ace95ced83e5 on user May 01 22:54:58 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-2cac78a3-74ad-4473-9dd9-1e1a2eaf07ba req-f57bf263-52e0-4b9b-a512-f417e9a07470 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027813 May 01 22:54:58 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 145/424] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:54:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=8 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:46 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 22:55:46 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 22:55:46 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 HTTP/1.1 May 01 22:55:46 user devstack@n-api.service[61364]: Accept: application/json May 01 22:55:46 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 22:55:46 user devstack@n-api.service[61364]: Connection: close May 01 22:55:46 user devstack@n-api.service[61364]: Content-Length: 0 May 01 22:55:46 user devstack@n-api.service[61364]: Content-Type: application/json May 01 22:55:46 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 22:55:46 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 22:55:46 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 22:55:46 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 22:55:46 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 22:55:46 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 22:55:46 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 22:55:46 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 22:55:46 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 22:55:46 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 22:55:46 user devstack@n-api.service[61364]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 22:55:46 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:55:46 user devstack@n-api.service[61364]: X-Role: member,reader May 01 22:55:46 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 22:55:46 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:55:46 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:55:46 user devstack@n-api.service[61364]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 22:55:46 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:55:46 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 22:55:46 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 22:55:46 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 22:55:46 user devstack@n-api.service[61364]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 22:55:46 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 22:55:46 user devstack@n-api.service[61364]: method: > May 01 22:55:46 user devstack@n-api.service[61364]: exception: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 22:55:46 user devstack@n-api.service[61364]: action_args: {'id': '03523e9f-691c-4428-b696-ace95ced83e5'} May 01 22:55:46 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:55:46 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 22:55:47 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 22:55:47 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:55:47 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-db275fec-98ff-4da0-b971-e8840b035fe4 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 404 len: 111 microversion: 2.1 time: 0.034819 May 01 22:55:47 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:55:46 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:55:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d47ac9ce-7efa-49f6-9f25-b6fa176cb2dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '.version_select at 0x7fc705d148b0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:55:47 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d47ac9ce-7efa-49f6-9f25-b6fa176cb2dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234927683" status: 202 len: 0 microversion: 2.1 time: 0.031760 May 01 22:55:47 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1298 bytes} [Mon May 1 22:55:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234927683 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:55:47 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:47 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:55:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-387a2085-811c-4d68-b423-06e97dd64839 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: .version_select at 0x7fc704422f80>, body: {"keypair": {"name": "tempest-keypair-1839922246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIqgyo3OYU7HaO2RaPl2Ft+hHPoDrwg9XDFx1JqM8JqZyYXJX2DjZ8m3kigQ2ee9NuntUcCyncKTMu7XTGq00aj5MoGDJ0stYvDuZFZrAoJdWjxF42pOZ9KJL/MKhEomw=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:55:47 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-387a2085-811c-4d68-b423-06e97dd64839 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:55:47 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-387a2085-811c-4d68-b423-06e97dd64839 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:55:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-387a2085-811c-4d68-b423-06e97dd64839 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049225 May 01 22:55:47 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 146/427] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:55:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1206577492", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d4380515-a8d0-4406-9cf8-d29e6b16bcea"}], "security_groups": [{"name": "tempest-securitygroup--1332340064"}], "key_name": "tempest-keypair-1839922246", "user_data": "}} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.network.neutron [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] validate_networks() for [('d4380515-a8d0-4406-9cf8-d29e6b16bcea', None, None, None, None, None)] {{(pid=61364) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image limits 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image pref 0:0:0 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.virt.hardware [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.quota [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61364) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Going to run 1 instances... {{(pid=61364) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:55:49 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61364) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:55:49 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-ee2a3982-9495-49e7-8a99-8395c0ffdc85 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.670912 May 01 22:55:49 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 141/428] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:55:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:55:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0ef0ed68-370e-4781-82f7-d34ac41854d7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:55:49 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0ef0ed68-370e-4781-82f7-d34ac41854d7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:55:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0ef0ed68-370e-4781-82f7-d34ac41854d7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:55:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0ef0ed68-370e-4781-82f7-d34ac41854d7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 200 len: 1236 microversion: 2.1 time: 0.069816 May 01 22:55:49 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 142/429] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:55:49 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:55:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:55:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] Creating event network-changed:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:55:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-295bb441-7c9f-46f6-85b2-461b34142afc req-a6370fe3-6864-4fd2-8744-dbe55432d6de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028480 May 01 22:55:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 147/430] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:55:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:55:54 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "name": "network-vif-plugged", "status": "completed", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:55:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:54 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:54 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] Creating event network-vif-plugged:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:55:54 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-afed7a51-6689-406c-8c68-fb3990ff7974 req-6e0b6ad1-6b85-4db5-a268-198ff319d310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037907 May 01 22:55:54 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 142/431] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:55:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:55:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "name": "network-vif-plugged", "status": "completed", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:55:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:55:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:55:56 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:55:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] Creating event network-vif-plugged:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:55:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-083124f0-08fc-4170-8238-eca3157e7cac req-b3ab3ea4-378f-43eb-adb7-664892b4e011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029303 May 01 22:55:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 143/432] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:56:39 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:56:39 user devstack@n-api.service[61365]: Mon May 1 22:56:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 (ip 10.0.0.210) !!! May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:56:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:56:40 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:56:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a4a4b5e2-8221-4469-a859-8a9a176fee1f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 200 len: 1547 microversion: 2.1 time: 0.312533 May 01 22:56:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 148/433] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:56:39 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 1547 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:40 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:57:40 user devstack@n-api.service[61364]: Mon May 1 22:57:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381/os-interface (ip 10.0.0.210) !!! May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=6 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:40 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:40 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-0022d4ff-9d98-4ccc-a413-d69d43e2ce8b tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.251202 May 01 22:57:40 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 143/434] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 22:57:40 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381/os-interface => generated 283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:41 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 22:57:41 user devstack@n-api.service[61366]: Mon May 1 22:57:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] Creating event network-changed:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:57:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-7a1e901f-28f8-46e0-b40b-490b084d7c27 req-b541f5f5-f754-409f-bb20-20ec280c5149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042850 May 01 22:57:41 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 144/435] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3fde1387-05a4-4fcc-9701-2c6d7adb5691 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381/ips" status: 200 len: 109 microversion: 2.1 time: 0.046183 May 01 22:57:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 149/436] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 22:57:41 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381/ips => generated 109 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:43 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Going to try to terminate instance {{(pid=61364) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 22:57:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-98de5ae1-702e-42bf-8bb9-b9537c65a689 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 204 len: 0 microversion: 2.1 time: 0.126113 May 01 22:57:43 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 144/437] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 22:57:43 2023] DELETE /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:43 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:57:43 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6e4538e7-67b9-44ab-887d-602536fe3c7f tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 200 len: 1672 microversion: 2.1 time: 0.275496 May 01 22:57:43 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:57:43 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 1672 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 22:57:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "name": "network-vif-unplugged", "status": "completed", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:57:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] Creating event network-vif-unplugged:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:57:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-a81dfc13-ad71-4401-b074-0dc801b73bc6 req-6322bd8c-b409-4b35-a7f8-c2e466b15b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039396 May 01 22:57:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 150/439] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:57:44 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "name": "network-vif-deleted", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:57:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:44 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] Creating event network-vif-deleted:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:57:44 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-6447f9f0-248f-45ee-b367-a3a1321eaabb req-778d8848-245e-407a-8aa3-7d7b08e8ef69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090868 May 01 22:57:44 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 145/440] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 22:57:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57dc55a-5451-49ba-ba20-60ea8a03d381", "name": "network-vif-plugged", "status": "completed", "tag": "ac30f700-49ac-42dd-bc17-9d383e127506"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:57:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:57:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:57:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:57:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] Creating event network-vif-plugged:ac30f700-49ac-42dd-bc17-9d383e127506 for instance a57dc55a-5451-49ba-ba20-60ea8a03d381 on user May 01 22:57:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a887c86f-9bc3-4515-8932-74df10564c3e req-198b413a-00e7-4988-8c26-1b3108eb6818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030701 May 01 22:57:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 22:58:33 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 HTTP/1.1 May 01 22:58:33 user devstack@n-api.service[61365]: Accept: application/json May 01 22:58:33 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 22:58:33 user devstack@n-api.service[61365]: Connection: close May 01 22:58:33 user devstack@n-api.service[61365]: Content-Length: 0 May 01 22:58:33 user devstack@n-api.service[61365]: Content-Type: application/json May 01 22:58:33 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 22:58:33 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 22:58:33 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 22:58:33 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 22:58:33 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 22:58:33 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 22:58:33 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 22:58:33 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 22:58:33 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 22:58:33 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 22:58:33 user devstack@n-api.service[61365]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 22:58:33 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:58:33 user devstack@n-api.service[61365]: X-Role: member,reader May 01 22:58:33 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 22:58:33 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 22:58:33 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:58:33 user devstack@n-api.service[61365]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 22:58:33 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 22:58:33 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 22:58:33 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 22:58:33 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 22:58:33 user devstack@n-api.service[61365]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 22:58:33 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 22:58:33 user devstack@n-api.service[61365]: method: > May 01 22:58:33 user devstack@n-api.service[61365]: exception: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 22:58:33 user devstack@n-api.service[61365]: action_args: {'id': 'a57dc55a-5451-49ba-ba20-60ea8a03d381'} May 01 22:58:33 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 22:58:33 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 22:58:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 22:58:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-82f9eead-1620-4f46-8136-62dcfe86bcaf tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 404 len: 111 microversion: 2.1 time: 0.126558 May 01 22:58:33 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 151/442] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:58:33 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 22:58:33 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:33 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:33 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:58:33 user devstack@n-api.service[61364]: Mon May 1 22:58:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1839922246 (ip 10.0.0.210) !!! May 01 22:58:33 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-75c9cdc8-6c84-4a2d-97c5-e64b552670c0 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '.version_select at 0x7fc70463ac20>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:58:33 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-75c9cdc8-6c84-4a2d-97c5-e64b552670c0 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839922246" status: 202 len: 0 microversion: 2.1 time: 0.035433 May 01 22:58:33 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 146/443] 10.0.0.210 () {62 vars in 1298 bytes} [Mon May 1 22:58:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839922246 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 22:58:34 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:34 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:58:34 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 22:58:34 user devstack@n-api.service[61366]: Mon May 1 22:58:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! May 01 22:58:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6ea95faf-cf25-453d-826c-4a5fd7898147 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: .version_select at 0x7fc7054cd5a0>, body: {"keypair": {"name": "tempest-keypair-792454159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmzra66rTCE/jUSSw664X0mzO4B+YDT/yT8XODU6IKSttsP286SBsedIbYaF3Tap5OJZEznQhZhLPxkh7sn9IlcTaDXk96DoRIvxKKPXeMcSk9G1KG8HsfNdDFaLX3UHQ=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:58:34 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-6ea95faf-cf25-453d-826c-4a5fd7898147 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:58:34 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-6ea95faf-cf25-453d-826c-4a5fd7898147 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:58:34 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6ea95faf-cf25-453d-826c-4a5fd7898147 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060462 May 01 22:58:34 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 147/444] 10.0.0.210 () {64 vars in 1236 bytes} [Mon May 1 22:58:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:58:35 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-554317927", "imageRef": "72b7991f-fc2a-4aea-99c6-77a5517bcd71", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d4380515-a8d0-4406-9cf8-d29e6b16bcea"}], "security_groups": [{"name": "tempest-securitygroup--1615845426"}], "key_name": "tempest-keypair-792454159", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] validate_networks() for [('d4380515-a8d0-4406-9cf8-d29e6b16bcea', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Getting quotas for user 63e65fc4cac840c79a22e171c68fcb2d and project 4f080587b60a491ca30d5c23ce504895. Resources: {'ram', 'instances', 'cores'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} May 01 22:58:36 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72b7991f-fc2a-4aea-99c6-77a5517bcd71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} May 01 22:58:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3455cb79-886c-4302-951c-9f2127d38ef8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.705385 May 01 22:58:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 152/445] 10.0.0.210 () {64 vars in 1224 bytes} [Mon May 1 22:58:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 01 22:58:36 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-5e5fe7d8-9e67-4f6f-ba9d-7c3aee7b4d42 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:58:36 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-5e5fe7d8-9e67-4f6f-ba9d-7c3aee7b4d42 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:58:36 user devstack@n-api.service[61364]: DEBUG nova.policy [None req-5e5fe7d8-9e67-4f6f-ba9d-7c3aee7b4d42 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61364) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:58:36 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-5e5fe7d8-9e67-4f6f-ba9d-7c3aee7b4d42 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 200 len: 1234 microversion: 2.1 time: 0.074347 May 01 22:58:36 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 147/446] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:58:36 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 1234 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 01 22:58:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:58:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] Creating event network-changed:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 22:58:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-17e1dcfe-f201-4144-bfcb-2c8f976d6291 req-db06a924-5e6d-4d07-99c2-51beb6ade2ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 May 01 22:58:39 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 148/447] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:58:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "name": "network-vif-plugged", "status": "completed", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:58:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] Creating event network-vif-plugged:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 22:58:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-171f482b-9d7f-4d3c-ab66-da81f8a574ef req-c698a27b-12fa-43eb-a778-761f4d4c9580 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 May 01 22:58:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 153/448] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:58:43 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "name": "network-vif-plugged", "status": "completed", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 22:58:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:58:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:58:43 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:58:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] Creating event network-vif-plugged:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 22:58:43 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-48f12672-3711-4ff1-879b-bb49e17d5abe req-6c810984-9d0e-4d1a-b6fa-075245e0c2fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 May 01 22:58:43 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 148/449] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 22:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 22:59:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 22:59:27 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 22:59:27 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-b5a3092e-e880-4188-ad6c-d35fb6b5482d tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 200 len: 1545 microversion: 2.1 time: 0.247061 May 01 22:59:27 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 22:59:26 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 1545 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:27 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 01 23:00:27 user devstack@n-api.service[61365]: Mon May 1 23:00:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3/os-interface (ip 10.0.0.210) !!! May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:27 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6e10518e-6cc8-4398-9907-70b25beb1e38 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.197843 May 01 23:00:27 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 154/451] 10.0.0.210 () {62 vars in 1352 bytes} [Mon May 1 23:00:27 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3/os-interface => generated 283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell0:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=2 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 23:00:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c28e8426-c4bd-49cc-b258-072d04e78766 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3/ips" status: 200 len: 109 microversion: 2.1 time: 0.038550 May 01 23:00:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1325 bytes} [Mon May 1 23:00:28 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:28 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:28 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] Creating event network-changed:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 23:00:28 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-493f7e3a-9c90-43de-bd5d-e942b3a487b6 req-e8710887-dd19-41b2-8615-53697c90480a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140032 May 01 23:00:28 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 149/453] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 23:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} May 01 23:00:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-adada98d-2b06-4fa3-bc48-a2e938e12484 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 204 len: 0 microversion: 2.1 time: 0.112805 May 01 23:00:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 155/454] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 23:00:29 2023] DELETE /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:29 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "name": "network-vif-unplugged", "status": "completed", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 23:00:29 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:29 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:29 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:29 user devstack@n-api.service[61364]: INFO nova.api.openstack.compute.server_external_events [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] Creating event network-vif-unplugged:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 23:00:29 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [req-49618694-19ac-4675-8a86-14f12e58bc59 req-a9ebd606-46b6-4c3a-aa03-095dcf004fd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034451 May 01 23:00:29 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 150/455] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 23:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 23:00:30 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e65fc4cac840c79a22e171c68fcb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f080587b60a491ca30d5c23ce504895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} May 01 23:00:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-873e570e-eb6c-4641-805b-d27a19192533 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 200 len: 1670 microversion: 2.1 time: 0.290802 May 01 23:00:30 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 151/456] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 23:00:29 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 01 23:00:31 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "name": "network-vif-plugged", "status": "completed", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}, {"server_uuid": "bc42de0b-1f11-4e2d-a6db-22b854a63ed3", "name": "network-vif-deleted", "tag": "80cd91a1-78a9-45c0-a013-4cb0d324503d"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 01 23:00:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:00:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:00:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:00:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Creating event network-vif-plugged:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 23:00:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] Creating event network-vif-deleted:80cd91a1-78a9-45c0-a013-4cb0d324503d for instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 on user May 01 23:00:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-41f459b0-10a7-4604-a973-c1a3135b442a req-4dfe09a1-acb8-4526-812f-cd36d6f885c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028694 May 01 23:00:32 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 156/457] 10.0.0.210 () {68 vars in 1394 bytes} [Mon May 1 23:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_api:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG dbcounter [-] [61364] Writing DB stats nova_cell1:SELECT=4 {{(pid=61364) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:20 user devstack@n-api.service[61364]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 23:01:20 user devstack@n-api.service[61364]: Mon May 1 23:01:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 (ip 10.0.0.210) !!! May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:20 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:20 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 HTTP/1.1 May 01 23:01:20 user devstack@n-api.service[61364]: Accept: application/json May 01 23:01:20 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 23:01:20 user devstack@n-api.service[61364]: Connection: close May 01 23:01:20 user devstack@n-api.service[61364]: Content-Length: 0 May 01 23:01:20 user devstack@n-api.service[61364]: Content-Type: application/json May 01 23:01:20 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 23:01:20 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 23:01:20 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 23:01:20 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:20 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 23:01:20 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 23:01:20 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 23:01:20 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 23:01:20 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 23:01:20 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 23:01:20 user devstack@n-api.service[61364]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:20 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:20 user devstack@n-api.service[61364]: X-Role: member,reader May 01 23:01:20 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 23:01:20 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:20 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:20 user devstack@n-api.service[61364]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:20 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:20 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:20 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 23:01:20 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 23:01:20 user devstack@n-api.service[61364]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:20 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:20 user devstack@n-api.service[61364]: method: > May 01 23:01:20 user devstack@n-api.service[61364]: exception: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:20 user devstack@n-api.service[61364]: action_args: {'id': 'bc42de0b-1f11-4e2d-a6db-22b854a63ed3'} May 01 23:01:20 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:20 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:20 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:20 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-4fdba8fb-d263-4624-ae64-47b385c71af2 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 404 len: 111 microversion: 2.1 time: 0.043591 May 01 23:01:20 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 151/458] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 23:01:20 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f5511b69-ed4b-42da-953b-67aea893c555 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '.version_select at 0x7fc7047e3eb0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f5511b69-ed4b-42da-953b-67aea893c555 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792454159" status: 202 len: 0 microversion: 2.1 time: 0.037534 May 01 23:01:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 152/459] 10.0.0.210 () {62 vars in 1295 bytes} [Mon May 1 23:01:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792454159 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} May 01 23:01:21 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 01 23:01:21 user devstack@n-api.service[61365]: Mon May 1 23:01:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 (ip 10.0.0.210) !!! May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61365]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61365]: Connection: close May 01 23:01:21 user devstack@n-api.service[61365]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61365]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61365]: method: > May 01 23:01:21 user devstack@n-api.service[61365]: exception: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: action_args: {'id': 'bc42de0b-1f11-4e2d-a6db-22b854a63ed3'} May 01 23:01:21 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-59882117-5a77-4115-9d08-81d329c88579 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 404 len: 111 microversion: 2.1 time: 0.039504 May 01 23:01:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 157/460] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 23:01:21 2023] DELETE /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: bc42de0b-1f11-4e2d-a6db-22b854a63ed3] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61364]: request: GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61364]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61364]: Connection: close May 01 23:01:21 user devstack@n-api.service[61364]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61364]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61364]: method: > May 01 23:01:21 user devstack@n-api.service[61364]: exception: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: action_args: {'id': 'bc42de0b-1f11-4e2d-a6db-22b854a63ed3'} May 01 23:01:21 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance bc42de0b-1f11-4e2d-a6db-22b854a63ed3 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-bcf5e4cd-85c0-4f21-b37c-eede153332d8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3" status: 404 len: 111 microversion: 2.1 time: 0.034636 May 01 23:01:21 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 152/461] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 23:01:21 2023] GET /compute/v2.1/servers/bc42de0b-1f11-4e2d-a6db-22b854a63ed3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61366]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61366]: Connection: close May 01 23:01:21 user devstack@n-api.service[61366]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61366]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61366]: method: > May 01 23:01:21 user devstack@n-api.service[61366]: exception: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: action_args: {'id': 'a57dc55a-5451-49ba-ba20-60ea8a03d381'} May 01 23:01:21 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-93e10e2a-5c24-4876-aca9-0407512ff5dc tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 404 len: 111 microversion: 2.1 time: 0.032444 May 01 23:01:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 153/462] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 23:01:21 2023] DELETE /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: a57dc55a-5451-49ba-ba20-60ea8a03d381] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61365]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61365]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61365]: Connection: close May 01 23:01:21 user devstack@n-api.service[61365]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61365]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61365]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61365]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61365]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61365]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61365]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61365]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61365]: method: > May 01 23:01:21 user devstack@n-api.service[61365]: exception: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: action_args: {'id': 'a57dc55a-5451-49ba-ba20-60ea8a03d381'} May 01 23:01:21 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. May 01 23:01:21 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance a57dc55a-5451-49ba-ba20-60ea8a03d381 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-647c5126-b4a2-4ba3-ba82-39f73ff50f49 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381" status: 404 len: 111 microversion: 2.1 time: 0.026805 May 01 23:01:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 158/463] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 23:01:21 2023] GET /compute/v2.1/servers/a57dc55a-5451-49ba-ba20-60ea8a03d381 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.compute.api [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61364) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG oslo_concurrency.lockutils [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.wsgi [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61364]: request: DELETE /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61364]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61364]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61364]: Connection: close May 01 23:01:21 user devstack@n-api.service[61364]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61364]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61364]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61364]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61364]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61364]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61364]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61364]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61364]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61364]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61364]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61364]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61364]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61364]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61364]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61364]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61364]: method: > May 01 23:01:21 user devstack@n-api.service[61364]: exception: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: action_args: {'id': '03523e9f-691c-4428-b696-ace95ced83e5'} May 01 23:01:21 user devstack@n-api.service[61364]: {{(pid=61364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61364]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61364]: DEBUG nova.api.openstack.wsgi [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. {{(pid=61364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61364]: INFO nova.api.openstack.requestlog [None req-994b55f0-98ba-4090-b88c-b7175d37f9e8 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 404 len: 111 microversion: 2.1 time: 0.027457 May 01 23:01:21 user devstack@n-api.service[61364]: [pid: 61364|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1316 bytes} [Mon May 1 23:01:21 2023] DELETE /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] [instance: 03523e9f-691c-4428-b696-ace95ced83e5] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Acquiring lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Lock "3894b638-48b8-4a73-93b9-2ff19b42c5cd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} May 01 23:01:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] HTTP exception thrown: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Request method failure captured: May 01 23:01:21 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 HTTP/1.1 May 01 23:01:21 user devstack@n-api.service[61366]: Accept: application/json May 01 23:01:21 user devstack@n-api.service[61366]: Accept-Encoding: identity May 01 23:01:21 user devstack@n-api.service[61366]: Connection: close May 01 23:01:21 user devstack@n-api.service[61366]: Content-Length: 0 May 01 23:01:21 user devstack@n-api.service[61366]: Content-Type: application/json May 01 23:01:21 user devstack@n-api.service[61366]: Host: 10.0.0.210 May 01 23:01:21 user devstack@n-api.service[61366]: Openstack-System-Scope: None May 01 23:01:21 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 May 01 23:01:21 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkUELMCKa9oSZVsyEiTG-p9SY_DcSzZAk78llbmNAgntEIgZLY_2rEK4N85Aa55fnCHvseGMOZx_p6zWYVOM9dDkaXj55aSoeBb5wl-Z0F9dHxBbJZL9UC-kwV8ztAJ5MTATA48v8jC3mLs4mF7-BMANkUtKpP5ycVB3r0jDKTb6zYtck May 01 23:01:21 user devstack@n-api.service[61366]: X-Domain-Id: None May 01 23:01:21 user devstack@n-api.service[61366]: X-Domain-Name: None May 01 23:01:21 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed May 01 23:01:21 user devstack@n-api.service[61366]: X-Is-Admin-Project: True May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-Role: member,reader May 01 23:01:21 user devstack@n-api.service[61366]: X-Roles: member,reader May 01 23:01:21 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f080587b60a491ca30d5c23ce504895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant-Id: 4f080587b60a491ca30d5c23ce504895 May 01 23:01:21 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464604989 May 01 23:01:21 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Domain-Id: default May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Domain-Name: Default May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Id: 63e65fc4cac840c79a22e171c68fcb2d May 01 23:01:21 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1464604989-project-member May 01 23:01:21 user devstack@n-api.service[61366]: method: > May 01 23:01:21 user devstack@n-api.service[61366]: exception: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: action_args: {'id': '03523e9f-691c-4428-b696-ace95ced83e5'} May 01 23:01:21 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. May 01 23:01:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi May 01 23:01:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] Returning 404 to user: Instance 03523e9f-691c-4428-b696-ace95ced83e5 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 01 23:01:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d753f54e-d4e5-4283-ab56-7fd6469336e7 tempest-AttachVolumeNegativeTest-1464604989 tempest-AttachVolumeNegativeTest-1464604989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5" status: 404 len: 111 microversion: 2.1 time: 0.034477 May 01 23:01:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 154/465] 10.0.0.210 () {62 vars in 1313 bytes} [Mon May 1 23:01:21 2023] GET /compute/v2.1/servers/03523e9f-691c-4428-b696-ace95ced83e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)